>>> kops: Building testing/kops 1.28.3-r0 (using abuild 3.12.0-r2) started Sat, 27 Jan 2024 16:38:55 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.29.0-r0) (2/5) Installing go (1.21.6-r0) (3/5) Installing readline (8.2.10-r0) (4/5) Installing bash (5.2.26-r0) Executing bash-5.2.26-r0.post-install (5/5) Installing .makedepends-kops (20240127.163856) Executing busybox-1.36.1-r19.trigger OK: 555 MiB in 112 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.3.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 146 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (22) The requested URL returned error: 404 >>> kops: Fetching kops-1.28.3.tar.gz::https://github.com/kubernetes/kops/archive/v1.28.3.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 5966k 0 5966k 0 0 4661k 0 --:--:-- 0:00:01 --:--:-- 5866k 100 15.6M 0 15.6M 0 0 7099k 0 --:--:-- 0:00:02 --:--:-- 8031k 100 22.8M 0 22.8M 0 0 7162k 0 --:--:-- 0:00:03 --:--:-- 7792k 100 27.9M 0 27.9M 0 0 6706k 0 --:--:-- 0:00:04 --:--:-- 7145k 100 32.7M 0 32.7M 0 0 6576k 0 --:--:-- 0:00:05 --:--:-- 6934k >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.3.tar.gz >>> kops: Checking sha512sums... kops-1.28.3.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.3.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.3/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.3/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.3 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading k8s.io/apimachinery v0.28.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading k8s.io/client-go v0.28.1 go: downloading golang.org/x/crypto v0.14.0 go: downloading go.uber.org/multierr v1.11.0 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading k8s.io/api v0.28.1 go: downloading github.com/spf13/pflag v1.0.5 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/sys v0.13.0 go: downloading golang.org/x/term v0.13.0 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading k8s.io/component-helpers v0.28.1 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/google/btree v1.0.1 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/gorilla/mux v1.8.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading github.com/google/s2a-go v0.1.5 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/google/go-tpm v0.9.0 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0127 16:41:38.742447 57617 addon.go:250] addon test wants to update all nodes I0127 16:41:38.744486 57617 addon.go:250] addon test wants to update workers nodes I0127 16:41:38.744837 57617 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0127 16:41:38.745305 57617 addon.go:283] installing PKI for "test" I0127 16:41:39.278279 57617 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.84s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.912s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.059s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I0127 16:41:44.978125 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:44.978338 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:44.978384 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:44.978437 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:44.978485 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:44.978551 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:44.978608 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:44.978633 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:44.978683 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:44.978720 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:44.984991 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:44.985077 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.029831 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.030131 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.030612 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:45.050222 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.050343 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.050385 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.050448 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.050509 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.050569 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.050608 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.050652 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.050697 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.050732 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.056586 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.056640 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.086293 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.086482 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.086841 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:45.092712 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.092827 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.092875 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.092933 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.092983 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.093045 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.093080 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.093111 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.093153 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.093180 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.096606 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.096665 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.131217 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.131473 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.131813 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:45.137562 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.137647 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.137686 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.137730 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.137768 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.137816 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.137850 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.137880 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.137919 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.137963 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.178738 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.178799 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.208793 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.208984 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.209307 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:45.217894 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.217972 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.218005 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.218039 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.218063 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.218093 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.218119 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.218135 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.218156 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.218173 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.222051 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.222106 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.260823 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.261092 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.261631 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:45.268215 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.268298 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.268323 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.268352 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.268375 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.268405 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.268433 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.268451 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.268474 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.268491 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.272435 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.272481 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.327279 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.327386 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.327678 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:45.333217 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.333282 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.333308 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.333338 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.333361 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.333390 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.333420 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.333439 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.333460 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.333477 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.337316 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.337378 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.366671 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.366842 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.367156 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.40s) === RUN TestCreateClusterHetzner I0127 16:41:45.377776 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.377920 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.377955 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.377998 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.378037 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.378084 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.378178 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.378211 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.378250 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.378277 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.382441 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.382485 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0127 16:41:45.477235 59286 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0127 16:41:45.477278 59286 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0127 16:41:45.484353 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.484423 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.484451 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.484479 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.484502 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.484530 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.484556 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.484572 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.484594 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.484610 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.516922 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.516979 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.595417 59286 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.23s) === RUN TestCreateClusterOpenStack I0127 16:41:45.603209 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.603315 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.603349 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.603398 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.603434 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.603484 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.603561 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.603594 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.603632 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.603658 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.607712 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.607764 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0127 16:41:45.707893 59286 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0127 16:41:45.707936 59286 new_cluster.go:1373] Cloud Provider ID: "openstack" I0127 16:41:45.710572 59286 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.11s) === RUN TestCreateClusterOpenStackOctavia I0127 16:41:45.718150 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.718231 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.718257 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.718287 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.718311 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.718344 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.718394 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.718412 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.718437 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.718455 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.721664 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.721703 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0127 16:41:45.784515 59286 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0127 16:41:45.784563 59286 new_cluster.go:1373] Cloud Provider ID: "openstack" I0127 16:41:45.786712 59286 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0127 16:41:45.786740 59286 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.08s) === RUN TestCreateClusterOpenStackNoDNS I0127 16:41:45.798298 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.798569 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.799104 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.799156 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.799185 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.799220 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.799281 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.799300 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.799325 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.799345 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.803549 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.803602 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0127 16:41:45.886348 59286 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0127 16:41:45.886428 59286 new_cluster.go:1373] Cloud Provider ID: "openstack" I0127 16:41:45.886502 59286 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0127 16:41:45.886545 59286 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.10s) === RUN TestCreateClusterCilium I0127 16:41:45.895845 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.895940 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.895970 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.896002 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.896026 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.896058 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.896115 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.896133 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.896157 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.896175 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.899951 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.900006 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.938996 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.939170 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.939543 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.05s) === RUN TestCreateClusterOverride I0127 16:41:45.945487 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:45.945577 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:45.945604 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:45.945636 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:45.945661 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:45.945694 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:45.945747 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:45.945764 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:45.945786 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:45.945805 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:45.949159 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.949211 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:45.993427 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:45.993946 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:45.994301 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.06s) === RUN TestCreateClusterKubernetesFeatureGates I0127 16:41:46.005600 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.005724 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.005758 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.005802 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.005839 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.005883 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.005953 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.005980 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.006012 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.006039 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.009446 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.009495 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.066013 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.066193 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:46.066658 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.07s) === RUN TestCreateClusterComplex I0127 16:41:46.074411 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.074500 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.074532 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.074574 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.074611 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.074655 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.074729 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.074758 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.074786 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.074805 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.078461 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.078503 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.136079 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.136416 59286 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0127 16:41:46.136435 59286 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0127 16:41:46.136449 59286 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0127 16:41:46.136869 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.07s) === RUN TestCreateClusterComplexPrivate I0127 16:41:46.146620 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.146734 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.146769 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.146809 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.146843 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.146886 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.146965 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.146991 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.147026 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.147048 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.151569 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.151646 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.174774 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.175156 59286 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0127 16:41:46.175174 59286 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0127 16:41:46.175187 59286 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0127 16:41:46.175198 59286 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0127 16:41:46.175210 59286 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0127 16:41:46.175221 59286 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0127 16:41:46.175233 59286 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0127 16:41:46.175247 59286 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0127 16:41:46.175262 59286 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0127 16:41:46.175276 59286 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0127 16:41:46.175787 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.05s) === RUN TestCreateClusterHA I0127 16:41:46.194137 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.194248 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.194277 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.194311 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.194335 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.194367 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.194420 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.194438 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.194459 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.194476 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.243377 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.243452 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.279095 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.279436 59286 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0127 16:41:46.279455 59286 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0127 16:41:46.279471 59286 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0127 16:41:46.279826 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:46.288844 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.288930 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.288957 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.288988 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.289011 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.289044 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.289071 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.289089 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.289113 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.289131 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.292700 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.292756 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.397858 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.398210 59286 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0127 16:41:46.398229 59286 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0127 16:41:46.398243 59286 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0127 16:41:46.398584 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.22s) === RUN TestCreateClusterMinimalGCE I0127 16:41:46.410918 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.411007 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.411035 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.411069 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.411094 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.411127 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.411178 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.411196 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.411218 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.411237 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.415105 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.415150 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.457377 59286 new_cluster.go:1373] Cloud Provider ID: "gce" I0127 16:41:46.457510 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0127 16:41:46.463104 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.463175 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.463213 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.463247 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.463272 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.463305 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.463332 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.463348 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.463373 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.463391 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.467005 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.467046 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.505195 59286 new_cluster.go:1373] Cloud Provider ID: "gce" I0127 16:41:46.505332 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.10s) === RUN TestCreateClusterHAGCE I0127 16:41:46.514488 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.514606 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.514644 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.514687 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.514727 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.514775 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.514862 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.514897 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.514937 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.514965 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.519456 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.519514 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.555986 59286 new_cluster.go:1373] Cloud Provider ID: "gce" I0127 16:41:46.556141 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.05s) === RUN TestCreateClusterGCE I0127 16:41:46.565601 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.565697 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.565726 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.565772 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.565802 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.565837 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.565888 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.565904 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.565925 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.565942 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.572172 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.572240 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.611513 59286 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0127 16:41:46.611617 59286 new_cluster.go:1373] Cloud Provider ID: "gce" I0127 16:41:46.611734 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.05s) === RUN TestCreateClusterHASharedZone I0127 16:41:46.620105 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.620227 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.620261 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.620298 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.620332 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.620374 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.620449 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.620474 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.620504 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.620528 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.625782 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.625890 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0127 16:41:46.690185 59286 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0127 16:41:46.690254 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.690699 59286 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0127 16:41:46.691269 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.08s) === RUN TestCreateClusterHASharedZones I0127 16:41:46.704672 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.704808 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.704848 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.704893 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.704933 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.704985 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.705066 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.705100 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.705140 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.705169 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.710186 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.710256 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0127 16:41:46.749336 59286 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0127 16:41:46.749397 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.749906 59286 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0127 16:41:46.749932 59286 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0127 16:41:46.750442 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.06s) === RUN TestCreateClusterPrivate I0127 16:41:46.762802 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.762898 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.762928 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.762960 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.762988 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.763023 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.763085 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.763105 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.763132 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.763152 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.768339 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.768389 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.841455 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.841687 59286 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0127 16:41:46.841707 59286 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0127 16:41:46.842097 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:46.842130 59286 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.09s) === RUN TestCreateClusterPrivateGCE I0127 16:41:46.848966 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.849054 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.849080 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.849114 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.849138 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.849170 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.849224 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.849242 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.849267 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.849285 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.853229 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.853275 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.902890 59286 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0127 16:41:46.902973 59286 new_cluster.go:1373] Cloud Provider ID: "gce" I0127 16:41:46.903073 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.06s) === RUN TestCreateClusterWithNGWSpecified I0127 16:41:46.910126 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.910219 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.910246 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.910277 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.910300 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.910333 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.910388 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.910406 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.910430 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.910448 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.914180 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.914222 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.946948 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:46.947169 59286 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0127 16:41:46.947189 59286 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0127 16:41:46.947564 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:46.947596 59286 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.04s) === RUN TestCreateClusterWithINGWSpecified I0127 16:41:46.954232 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:46.954318 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:46.954345 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:46.954376 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:46.954401 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:46.954432 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:46.954485 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:46.954502 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:46.954529 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:46.954548 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:46.958151 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:46.958193 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.051711 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.052081 59286 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0127 16:41:47.052111 59286 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0127 16:41:47.052647 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:47.052692 59286 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.11s) === RUN TestCreateClusterSharedVPC I0127 16:41:47.062790 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.062889 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.062918 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.062954 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.062980 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.063010 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.063065 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.063082 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.063112 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.063141 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.067730 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.067773 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.092762 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.092916 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.092962 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.093001 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.093017 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.093057 59286 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0127 16:41:47.093406 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.04s) === RUN TestCreateClusterSharedSubnets I0127 16:41:47.099082 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.099164 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.099189 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.099216 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.099241 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.099272 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.099323 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.099340 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.099364 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.099382 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.103336 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.103376 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.148810 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.148934 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.149096 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.149366 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.149429 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.149496 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.149554 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.150122 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.06s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0127 16:41:47.159200 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.159360 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.159403 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.159451 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.159493 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.159548 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.159636 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.159672 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.159715 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.159747 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.163940 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.164014 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.225072 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:41:47.225146 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.225190 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.225331 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.225583 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.225623 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.225688 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.225722 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.226279 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.08s) === RUN TestCreateClusterPrivateSharedSubnets I0127 16:41:47.236305 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.236429 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.236466 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.236509 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.236566 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.236620 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.236708 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.236740 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.236779 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.236808 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.240867 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.240909 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.274192 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.274276 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.274359 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.274383 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.274450 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.274616 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.274638 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.274663 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:41:47.274680 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:41:47.275078 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.04s) === RUN TestCreateClusterIPv6 I0127 16:41:47.280991 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.281079 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.281104 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.281131 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.281154 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.281186 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.281238 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.281255 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.281279 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.281297 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.285286 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.285324 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.358948 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.359133 59286 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0127 16:41:47.359152 59286 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0127 16:41:47.359683 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.09s) === RUN TestCreateClusterDifferentAMIs I0127 16:41:47.366178 59286 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0127 16:41:47.366191 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.366272 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.366300 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.366330 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.366354 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.366385 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.366437 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.366454 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.366481 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.366498 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.370459 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.370520 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.464328 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.464418 59286 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0127 16:41:47.464436 59286 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0127 16:41:47.464785 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:47.471882 59286 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.11s) === RUN TestCreateClusterKarpenter I0127 16:41:47.471987 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.472078 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.472104 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.472132 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.472154 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.472183 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.472233 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.472251 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.472273 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.472294 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.476040 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.476085 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0127 16:41:47.526816 59286 new_cluster.go:1373] Cloud Provider ID: "aws" I0127 16:41:47.527147 59286 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0127 16:41:47.527174 59286 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0127 16:41:47.527192 59286 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0127 16:41:47.527748 59286 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.06s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0127 16:41:47.535874 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.535962 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.535993 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.536058 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.536090 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.536126 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.536158 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.536179 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.536206 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.536229 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.542546 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I0127 16:41:47.543832 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:47.543902 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:47.543923 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:47.543946 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:47.543968 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:47.543994 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:47.544042 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:47.544062 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:47.544083 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:47.544097 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:47.558202 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0127 16:41:47.559953 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:47.560002 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0127 16:41:52.643952 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:57.072913 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:41:57.073722 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:41:57.073750 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:41:57.073866 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:41:57.084499 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:41:57.096587 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:41:57.099611 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:57.102064 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:57.102276 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:57.105834 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:57.106022 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:41:57.106810 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:41:57.107237 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:41:57.112411 59286 target.go:111] Terraform output is in /tmp/test949094620/out --- PASS: TestMinimal (9.57s) === RUN TestMinimal_v1_23 I0127 16:41:57.116441 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:57.116572 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:57.116616 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:57.116710 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:57.116754 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:57.116802 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:57.116846 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:57.116878 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:57.116918 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:57.116946 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:57.143894 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0127 16:41:57.147831 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:57.147995 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:59.377459 59286 zones.go:93] ListHostedZonesPages { } I0127 16:41:59.510248 59286 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0127 16:41:59.510656 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:41:59.510682 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:41:59.510748 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:41:59.512613 59286 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0127 16:41:59.516133 59286 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0127 16:41:59.516471 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:59.517374 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:59.518081 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:59.518226 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:59.518367 59286 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0127 16:41:59.519017 59286 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0127 16:41:59.520605 59286 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0127 16:41:59.524014 59286 target.go:111] Terraform output is in /tmp/test4208546093/out --- PASS: TestMinimal_v1_23 (2.41s) === RUN TestMinimal_v1_24 I0127 16:41:59.526584 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:59.526672 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:59.526702 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:59.526764 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:59.526790 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:59.526821 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:59.526851 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:59.526870 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:59.526896 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:59.526914 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:59.544323 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:41:59.546268 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:41:59.546327 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:01.888993 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:02.030393 59286 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0127 16:42:02.034274 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:02.034307 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:02.034398 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:02.037880 59286 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0127 16:42:02.042400 59286 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0127 16:42:02.042784 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:02.042968 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:02.043259 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:02.043367 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:02.043430 59286 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0127 16:42:02.043664 59286 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0127 16:42:02.043894 59286 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0127 16:42:02.049166 59286 target.go:111] Terraform output is in /tmp/test1372836100/out --- PASS: TestMinimal_v1_24 (2.53s) === RUN TestMinimal_v1_25 I0127 16:42:02.053649 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:02.053779 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:02.053826 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:02.053879 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:02.053925 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:02.053979 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:02.054064 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:02.054097 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:02.054141 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:02.054170 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:02.082422 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:42:02.085214 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:02.085307 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:03.852188 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:04.005525 59286 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0127 16:42:04.009341 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:04.009382 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:04.009481 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:04.011657 59286 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0127 16:42:04.017326 59286 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0127 16:42:04.017645 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:04.017837 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:04.018163 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:04.018211 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:04.018293 59286 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0127 16:42:04.018487 59286 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0127 16:42:04.018699 59286 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0127 16:42:04.021938 59286 target.go:111] Terraform output is in /tmp/test2667609114/out --- PASS: TestMinimal_v1_25 (1.97s) === RUN TestMinimal_v1_26 I0127 16:42:04.024760 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:04.024849 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:04.024879 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:04.024913 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:04.024938 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:04.024970 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:04.025029 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:04.025049 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:04.025076 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:04.025095 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:04.040929 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:42:04.042895 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:04.042957 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:05.782413 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:05.918195 59286 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0127 16:42:05.919366 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:05.919389 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:05.919466 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:05.922873 59286 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0127 16:42:05.927176 59286 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0127 16:42:05.927500 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:05.927664 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:05.927964 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:05.928096 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:05.928159 59286 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0127 16:42:05.928397 59286 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0127 16:42:05.928542 59286 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0127 16:42:05.931693 59286 target.go:111] Terraform output is in /tmp/test2724781090/out --- PASS: TestMinimal_v1_26 (1.91s) === RUN TestMinimal_v1_27 I0127 16:42:05.934334 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:05.934418 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:05.934447 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:05.934476 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:05.934499 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:05.934530 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:05.934583 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:05.934603 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:05.934627 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:05.934644 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:05.950182 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0127 16:42:05.952114 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:05.952171 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:08.694060 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:08.899481 59286 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0127 16:42:08.900984 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:08.901009 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:08.901114 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:08.907075 59286 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0127 16:42:08.914229 59286 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0127 16:42:08.914615 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:08.914892 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:08.915044 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:08.915370 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:08.915451 59286 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0127 16:42:08.915777 59286 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0127 16:42:08.916064 59286 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0127 16:42:08.919357 59286 target.go:111] Terraform output is in /tmp/test3327001783/out --- PASS: TestMinimal_v1_27 (2.99s) === RUN TestMinimal_NoneDNS I0127 16:42:08.921989 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:08.922067 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:08.922094 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:08.922123 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:08.922145 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:08.922176 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:08.922226 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:08.922242 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:08.922263 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:08.922279 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:42:08.940252 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:08.940316 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:10.564572 59286 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0127 16:42:10.570478 59286 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0127 16:42:10.575031 59286 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0127 16:42:10.575930 59286 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0127 16:42:10.575961 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:10.576028 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:10.576140 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:10.576211 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:10.579626 59286 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0127 16:42:10.579736 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:10.579821 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:10.580198 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:10.580363 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:10.580486 59286 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0127 16:42:10.580771 59286 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0127 16:42:10.581029 59286 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0127 16:42:10.586587 59286 target.go:111] Terraform output is in /tmp/test698059835/out --- PASS: TestMinimal_NoneDNS (1.67s) === RUN TestHetzner I0127 16:42:10.590848 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:42:12.591998 59286 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0127 16:42:12.599567 59286 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0127 16:42:12.600096 59286 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0127 16:42:12.604774 59286 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0127 16:42:12.605796 59286 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0127 16:42:12.608512 59286 target.go:111] Terraform output is in /tmp/test3066271284/out --- PASS: TestHetzner (2.02s) === RUN TestNvidia I0127 16:42:12.611566 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:12.611699 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:12.611743 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:12.611839 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:12.611881 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:12.611932 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:12.611974 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:12.612007 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:12.612044 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:12.612072 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:12.637572 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:12.640765 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:12.640901 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:14.684147 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:14.856123 59286 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0127 16:42:14.858077 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:14.858123 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:14.858220 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:14.858851 59286 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0127 16:42:14.861959 59286 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0127 16:42:14.862245 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:14.862451 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:14.862616 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:14.862648 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:14.862709 59286 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0127 16:42:14.862977 59286 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0127 16:42:14.863189 59286 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0127 16:42:14.869090 59286 target.go:111] Terraform output is in /tmp/test3745428795/out --- PASS: TestNvidia (2.26s) === RUN TestMinimalGossip I0127 16:42:14.871316 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:14.871431 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:14.871462 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:14.871538 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:14.871567 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:14.871616 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:14.871662 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:14.871680 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:14.871718 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:14.871743 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:14.883821 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:14.883879 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:16.352982 59286 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0127 16:42:16.355505 59286 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0127 16:42:16.361456 59286 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0127 16:42:16.361716 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:16.361856 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:16.362074 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:16.362126 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:16.362200 59286 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0127 16:42:16.362428 59286 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0127 16:42:16.362660 59286 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0127 16:42:16.367409 59286 target.go:111] Terraform output is in /tmp/test3865070591/out --- PASS: TestMinimalGossip (1.50s) === RUN TestMinimalGossipIRSA I0127 16:42:16.371442 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:16.371568 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:16.371610 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:16.371659 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:16.371698 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:16.371753 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:16.371839 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:16.371869 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:16.371906 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:16.371936 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:16.865326 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:16.865391 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:18.335986 59286 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0127 16:42:18.341011 59286 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0127 16:42:18.348819 59286 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0127 16:42:18.349115 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:18.349523 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:18.349734 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:18.350214 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:18.350312 59286 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0127 16:42:18.350555 59286 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0127 16:42:18.350754 59286 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0127 16:42:18.392818 59286 target.go:111] Terraform output is in /tmp/test1944072798/out --- PASS: TestMinimalGossipIRSA (2.52s) === RUN TestMinimalGCE I0127 16:42:18.888237 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:18.890345 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:20.818032 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:20.818104 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:20.818201 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0127 16:42:20.818225 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0127 16:42:20.818239 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0127 16:42:20.818287 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:42:20.819216 59286 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0127 16:42:20.821415 59286 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0127 16:42:20.826426 59286 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0127 16:42:20.827357 59286 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0127 16:42:20.827649 59286 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0127 16:42:20.830370 59286 target.go:111] Terraform output is in /tmp/test1952207863/out --- PASS: TestMinimalGCE (1.94s) === RUN TestMinimalGCEPrivate I0127 16:42:20.833063 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:20.834631 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:22.611879 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:22.611960 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:22.612070 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0127 16:42:22.612096 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0127 16:42:22.612114 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0127 16:42:22.612165 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:42:22.613273 59286 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0127 16:42:22.615736 59286 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0127 16:42:22.624953 59286 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0127 16:42:22.626110 59286 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0127 16:42:22.626282 59286 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0127 16:42:22.629590 59286 target.go:111] Terraform output is in /tmp/test1037925996/out --- PASS: TestMinimalGCEPrivate (1.80s) === RUN TestMinimalGCEInternalLoadBalancer I0127 16:42:22.632900 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:22.634692 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:24.377202 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:24.377288 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:24.377417 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0127 16:42:24.377449 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0127 16:42:24.377473 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0127 16:42:24.377532 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0127 16:42:24.377572 59286 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0127 16:42:24.379141 59286 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0127 16:42:24.384159 59286 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0127 16:42:24.386655 59286 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0127 16:42:24.387732 59286 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0127 16:42:24.393706 59286 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0127 16:42:24.394452 59286 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0127 16:42:24.394585 59286 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0127 16:42:24.394796 59286 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0127 16:42:24.394978 59286 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0127 16:42:24.397163 59286 target.go:111] Terraform output is in /tmp/test1166502571/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.77s) === RUN TestMinimalGCEPublicLoadBalancer I0127 16:42:24.399068 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:24.400234 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:26.113506 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:26.113563 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:26.113640 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0127 16:42:26.113661 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0127 16:42:26.113675 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0127 16:42:26.113717 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:42:26.114701 59286 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0127 16:42:26.118569 59286 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0127 16:42:26.125149 59286 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0127 16:42:26.125746 59286 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0127 16:42:26.125862 59286 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0127 16:42:26.127815 59286 target.go:111] Terraform output is in /tmp/test2661127195/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.73s) === RUN TestMinimalGCELongClusterName I0127 16:42:26.129727 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:26.130757 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:27.816115 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:27.816198 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:27.816290 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0127 16:42:27.816313 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0127 16:42:27.816331 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0127 16:42:27.816377 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:42:27.818947 59286 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0127 16:42:27.822979 59286 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0127 16:42:27.826313 59286 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0127 16:42:27.826908 59286 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0127 16:42:27.827016 59286 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0127 16:42:27.829031 59286 target.go:111] Terraform output is in /tmp/test1790931096/out --- PASS: TestMinimalGCELongClusterName (1.70s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0127 16:42:27.830999 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:27.832086 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:29.540736 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:29.540799 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:29.540899 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0127 16:42:29.540921 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0127 16:42:29.540937 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0127 16:42:29.540976 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0127 16:42:29.541008 59286 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0127 16:42:29.541968 59286 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0127 16:42:29.544339 59286 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0127 16:42:29.544721 59286 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0127 16:42:29.544914 59286 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0127 16:42:29.548122 59286 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0127 16:42:29.548778 59286 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0127 16:42:29.548911 59286 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0127 16:42:29.549028 59286 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0127 16:42:29.549138 59286 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0127 16:42:29.551215 59286 target.go:111] Terraform output is in /tmp/test3284466766/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.72s) === RUN TestMinimalGCEDNSNone I0127 16:42:29.553272 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:29.554906 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:31.436376 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:31.436584 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:31.436789 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0127 16:42:31.436860 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0127 16:42:31.436925 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0127 16:42:31.437119 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0127 16:42:31.437215 59286 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0127 16:42:31.438950 59286 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0127 16:42:31.449873 59286 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0127 16:42:31.451318 59286 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0127 16:42:31.451553 59286 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0127 16:42:31.458316 59286 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0127 16:42:31.460906 59286 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0127 16:42:31.461097 59286 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0127 16:42:31.461244 59286 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0127 16:42:31.461427 59286 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0127 16:42:31.464876 59286 target.go:111] Terraform output is in /tmp/test2785590411/out --- PASS: TestMinimalGCEDNSNone (1.91s) === RUN TestMinimalScaleway I0127 16:42:31.467993 59286 featureflag.go:164] FeatureFlag "Scaleway"=true I0127 16:42:31.468015 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:42:33.587182 59286 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0127 16:42:33.590474 59286 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0127 16:42:33.595426 59286 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0127 16:42:33.596542 59286 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0127 16:42:33.598476 59286 target.go:111] Terraform output is in /tmp/test2638540626/out I0127 16:42:33.601239 59286 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (2.13s) === RUN TestHA I0127 16:42:33.601335 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:33.601427 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:33.601459 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:33.601523 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:33.601551 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:33.601583 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:33.601611 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:33.601629 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:33.601652 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:33.601669 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:33.621395 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:33.623575 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:33.623635 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:33.623670 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:33.623703 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:34.929153 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:35.070488 59286 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0127 16:42:35.073337 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:35.073357 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:35.073412 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:35.074543 59286 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0127 16:42:35.078403 59286 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0127 16:42:35.078545 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.078707 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.078870 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.078979 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.079094 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.079215 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.079266 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.079463 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:35.079532 59286 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0127 16:42:35.079794 59286 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0127 16:42:35.080024 59286 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0127 16:42:35.084323 59286 target.go:111] Terraform output is in /tmp/test2993855654/out --- PASS: TestHA (1.49s) === RUN TestHighAvailabilityGCE I0127 16:42:35.087558 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:35.088797 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:42:36.833351 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:42:36.833424 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:42:36.833505 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0127 16:42:36.833525 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0127 16:42:36.833540 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0127 16:42:36.833582 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0127 16:42:36.833633 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0127 16:42:36.833674 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:42:36.834852 59286 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0127 16:42:36.836961 59286 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0127 16:42:36.844146 59286 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0127 16:42:36.844858 59286 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0127 16:42:36.845112 59286 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0127 16:42:36.847893 59286 target.go:111] Terraform output is in /tmp/test1053405548/out --- PASS: TestHighAvailabilityGCE (1.76s) === RUN TestComplex I0127 16:42:36.850408 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:36.850485 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:36.850512 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:36.850565 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:36.850589 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:36.850619 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:36.850643 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:36.850660 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:36.850683 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:36.850698 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:36.869815 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:42:36.872230 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:36.872290 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:38.820548 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:38.951924 59286 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0127 16:42:38.952728 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:38.952751 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:38.952826 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:38.954169 59286 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0127 16:42:38.956027 59286 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0127 16:42:38.956513 59286 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0127 16:42:38.956672 59286 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0127 16:42:38.956702 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:38.956744 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:38.956782 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:38.956824 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:38.959913 59286 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0127 16:42:38.960065 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:38.960247 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:38.960416 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:38.960684 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:38.960742 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:42:38.960971 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:42:38.961155 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0127 16:42:38.964865 59286 target.go:111] Terraform output is in /tmp/test2519445740/out I0127 16:42:38.967453 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:38.967517 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:38.967541 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:38.967566 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:38.967589 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:38.967618 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:38.967643 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:38.967658 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:38.967681 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:38.967697 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:38.989565 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:42:38.992586 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:38.992653 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:40.292282 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:40.432425 59286 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0127 16:42:40.433506 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:40.433531 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:40.433600 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:40.440232 59286 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0127 16:42:40.442032 59286 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0127 16:42:40.442704 59286 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0127 16:42:40.442896 59286 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0127 16:42:40.442921 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:40.442974 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:40.443092 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:40.443136 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:40.445493 59286 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0127 16:42:40.445579 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:40.445723 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:40.445886 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:40.446136 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:40.446197 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:42:40.446381 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:42:40.446661 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0127 16:42:40.453352 59286 target.go:111] Terraform output is in /tmp/test1690994132/out --- PASS: TestComplex (3.61s) === RUN TestCompress I0127 16:42:40.457710 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:40.457876 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:40.457930 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:40.457976 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:40.458021 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:40.458078 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:40.458180 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:40.458216 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:40.458256 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:40.458297 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:40.482204 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:40.485834 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:40.485925 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:41.804557 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:41.946514 59286 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0127 16:42:41.949309 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:41.949354 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:41.949504 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:41.954541 59286 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0127 16:42:41.958184 59286 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0127 16:42:41.958685 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:41.958967 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:41.960219 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:41.960507 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:41.960584 59286 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0127 16:42:41.960906 59286 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0127 16:42:41.961214 59286 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0127 16:42:41.966248 59286 target.go:111] Terraform output is in /tmp/test1652470632/out --- PASS: TestCompress (1.51s) === RUN TestExternalPolicies I0127 16:42:41.970668 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:41.970790 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:41.970830 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:41.970871 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:41.970908 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:41.970957 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:41.971039 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:41.971068 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:41.971104 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:41.971132 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:41.999932 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:42.003271 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:42.003350 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:43.330678 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:43.518641 59286 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0127 16:42:43.519813 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:43.519892 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:43.520029 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:43.522042 59286 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0127 16:42:43.525549 59286 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0127 16:42:43.526469 59286 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0127 16:42:43.526582 59286 api.go:53] PageSize not implemented W0127 16:42:43.526748 59286 api.go:53] PageSize not implemented I0127 16:42:43.532215 59286 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0127 16:42:43.532390 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:43.532641 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:43.532900 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:43.533534 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:43.533657 59286 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0127 16:42:43.534030 59286 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0127 16:42:43.534406 59286 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0127 16:42:43.540322 59286 target.go:111] Terraform output is in /tmp/test34552681/out --- PASS: TestExternalPolicies (1.57s) === RUN TestMinimalIPv6 I0127 16:42:43.544775 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:43.544899 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:43.544940 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:43.545028 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:43.545073 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:43.545127 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:43.545170 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:43.545197 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:43.545234 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:43.545260 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:43.580199 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:42:43.583989 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:43.584083 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:44.877318 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:45.068420 59286 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0127 16:42:45.069445 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:45.069472 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:45.069553 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:45.071815 59286 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0127 16:42:45.074421 59286 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0127 16:42:45.076107 59286 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0127 16:42:45.077178 59286 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0127 16:42:45.077364 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:45.077575 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:45.077677 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:45.077805 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:45.086153 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:42:45.086356 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:45.086547 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:45.086860 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:45.087373 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:45.087498 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:42:45.087829 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:42:45.088164 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:42:45.094871 59286 target.go:111] Terraform output is in /tmp/test1852608474/out --- PASS: TestMinimalIPv6 (1.55s) === RUN TestMinimalIPv6Calico I0127 16:42:45.099421 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:45.099546 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:45.099590 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:45.099677 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:45.099719 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:45.099769 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:45.099814 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:45.099842 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:45.099907 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:45.099939 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:45.130259 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:42:45.133804 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:45.133884 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:46.471912 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:46.911411 59286 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0127 16:42:46.912170 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:46.912217 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:46.912321 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:46.919630 59286 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0127 16:42:46.922964 59286 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0127 16:42:46.923725 59286 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0127 16:42:46.924096 59286 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0127 16:42:46.924195 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:46.924275 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:46.924424 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:46.924507 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:46.930072 59286 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0127 16:42:46.930267 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:46.930499 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:46.930783 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:46.931319 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:46.931443 59286 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0127 16:42:46.931760 59286 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0127 16:42:46.932110 59286 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0127 16:42:46.939137 59286 target.go:111] Terraform output is in /tmp/test2791304372/out --- PASS: TestMinimalIPv6Calico (1.85s) === RUN TestMinimalIPv6Cilium I0127 16:42:46.944980 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:46.945112 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:46.945155 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:46.945244 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:46.945286 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:46.945336 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:46.945380 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:46.945408 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:46.945447 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:46.945475 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:46.981173 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:42:46.986263 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:46.986367 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:48.290152 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:48.522831 59286 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0127 16:42:48.523285 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:48.523316 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:48.523413 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:48.528283 59286 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0127 16:42:48.533668 59286 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0127 16:42:48.534694 59286 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0127 16:42:48.535116 59286 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0127 16:42:48.535262 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:48.535383 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:48.535537 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:48.535623 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:48.541458 59286 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0127 16:42:48.541753 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:48.542054 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:48.542793 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:48.542962 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:48.543158 59286 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0127 16:42:48.543574 59286 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0127 16:42:48.543883 59286 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0127 16:42:48.550856 59286 target.go:111] Terraform output is in /tmp/test734608499/out --- PASS: TestMinimalIPv6Cilium (1.61s) === RUN TestMinimalIPv6NoSubnetPrefix I0127 16:42:48.555713 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:48.555845 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:48.555887 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:48.555974 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:48.556014 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:48.556066 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:48.556110 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:48.556139 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:48.556179 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:48.556208 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:48.586026 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:42:48.589702 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:48.589786 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:50.054419 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:50.241901 59286 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0127 16:42:50.242788 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:50.242818 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:50.242895 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:50.247025 59286 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0127 16:42:50.252875 59286 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0127 16:42:50.253836 59286 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0127 16:42:50.254238 59286 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0127 16:42:50.254435 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:50.254518 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:50.254621 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:42:50.254689 59286 loadbalancers.go:35] PageSize not implemented I0127 16:42:50.260420 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:42:50.260688 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:50.260964 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:50.261441 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:50.261529 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:50.261619 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:42:50.261907 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:42:50.262292 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:42:50.268980 59286 target.go:111] Terraform output is in /tmp/test3548911326/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.73s) === RUN TestMinimalWarmPool I0127 16:42:50.284217 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:50.284345 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:50.284390 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:50.284435 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:50.284475 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:50.284529 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:50.284610 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:50.284639 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:50.284678 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:50.284707 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:50.310372 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:50.314007 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:50.314092 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:51.664933 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:51.897847 59286 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0127 16:42:51.898674 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:51.898709 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:51.898811 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:51.901459 59286 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0127 16:42:51.907155 59286 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0127 16:42:51.907673 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:51.907892 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:51.909265 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:51.909952 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:51.910231 59286 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0127 16:42:51.911039 59286 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0127 16:42:51.912459 59286 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0127 16:42:51.920049 59286 target.go:111] Terraform output is in /tmp/test192685328/out --- PASS: TestMinimalWarmPool (1.64s) === RUN TestMinimalEtcd I0127 16:42:51.924747 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:51.924882 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:51.924925 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:51.925010 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:51.925052 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:51.925118 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:51.925164 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:51.925193 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:51.925230 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:51.925259 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:51.951420 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:51.954767 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:51.954858 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:53.463724 59286 zones.go:93] ListHostedZonesPages { } W0127 16:42:53.631806 59286 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0127 16:42:53.631866 59286 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0127 16:42:53.633921 59286 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0127 16:42:53.643463 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:42:53.645241 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:53.645347 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:53.645503 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:53.652892 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:42:53.659032 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:42:53.659357 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:53.659539 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:53.660129 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:53.660283 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:53.660406 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:42:53.660698 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:42:53.661049 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:42:53.666209 59286 target.go:111] Terraform output is in /tmp/test1051787411/out --- PASS: TestMinimalEtcd (1.75s) === RUN TestMinimalGp3 I0127 16:42:53.670797 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:53.670936 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:53.670982 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:53.671040 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:53.671083 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:53.671132 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:53.671217 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:53.671246 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:53.671285 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:53.671314 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:53.697448 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:53.700775 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:53.700864 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:55.001356 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:55.190367 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:42:55.193511 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:55.193556 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:55.193674 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:55.196711 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:42:55.203831 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:42:55.204267 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:55.204523 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:55.204785 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:55.205285 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:55.205424 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:42:55.205750 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:42:55.206124 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:42:55.211870 59286 target.go:111] Terraform output is in /tmp/test2819602271/out --- PASS: TestMinimalGp3 (1.55s) === RUN TestMinimalLongClusterName I0127 16:42:55.216297 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:55.216418 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:55.216458 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:55.216504 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:55.216567 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:55.216621 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:55.216725 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:55.216755 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:55.216793 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:55.216829 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:55.241480 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:55.244657 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:55.244736 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0127 16:42:56.571813 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:56.759607 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:42:56.760272 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:56.760311 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:56.760400 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:56.767311 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:42:56.774308 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:42:56.774609 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.774979 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.775210 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.775899 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.776039 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:42:56.776397 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:42:56.776806 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:42:56.782568 59286 target.go:111] Terraform output is in /tmp/test751993507/out --- PASS: TestMinimalLongClusterName (1.57s) === RUN TestExistingSG I0127 16:42:56.787245 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:56.787382 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:56.787425 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:56.787511 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:56.787557 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:56.787607 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:56.787652 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:56.787686 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:56.787726 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:56.787754 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:56.821201 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:56.824758 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.824843 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.824898 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:56.824988 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.149815 59286 zones.go:93] ListHostedZonesPages { } I0127 16:42:58.345349 59286 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0127 16:42:58.348790 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:42:58.348874 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:42:58.349020 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:42:58.350886 59286 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0127 16:42:58.356296 59286 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0127 16:42:58.357383 59286 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0127 16:42:58.357465 59286 api.go:53] PageSize not implemented W0127 16:42:58.357500 59286 api.go:53] PageSize not implemented W0127 16:42:58.357602 59286 api.go:53] PageSize not implemented W0127 16:42:58.357724 59286 api.go:53] PageSize not implemented I0127 16:42:58.364650 59286 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0127 16:42:58.364859 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.365007 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.365250 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.365473 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.365712 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.365819 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.365900 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.366004 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.366133 59286 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0127 16:42:58.366513 59286 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0127 16:42:58.366963 59286 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0127 16:42:58.375331 59286 target.go:111] Terraform output is in /tmp/test2072182604/out --- PASS: TestExistingSG (1.59s) === RUN TestBastionAdditionalUserData I0127 16:42:58.380956 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:58.381088 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:58.381128 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:58.381177 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:58.381226 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:58.381278 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:58.381363 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:58.381393 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:58.381431 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:58.381461 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:58.415051 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:42:58.419780 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.419918 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:58.420023 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:42:59.891435 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:00.078957 59286 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0127 16:43:00.079523 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:00.079569 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:00.079713 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:00.082733 59286 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0127 16:43:00.086107 59286 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0127 16:43:00.086899 59286 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0127 16:43:00.087065 59286 api.go:53] PageSize not implemented W0127 16:43:00.087129 59286 api.go:53] PageSize not implemented W0127 16:43:00.087262 59286 api.go:53] PageSize not implemented I0127 16:43:00.092900 59286 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0127 16:43:00.093125 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.093444 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.093772 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.093989 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.094121 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.094252 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.094364 59286 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0127 16:43:00.094727 59286 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0127 16:43:00.095192 59286 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0127 16:43:00.102240 59286 target.go:111] Terraform output is in /tmp/test4193029981/out --- PASS: TestBastionAdditionalUserData (1.73s) === RUN TestPrivateFlannel I0127 16:43:00.112278 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:00.112441 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:00.112490 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:00.112602 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:00.112665 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:00.112733 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:00.112786 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:00.112835 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:00.112891 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:00.112924 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:00.141646 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:43:00.145228 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.145319 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:00.145393 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.479470 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:01.673899 59286 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0127 16:43:01.676144 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:01.676224 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:01.676336 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:01.683722 59286 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0127 16:43:01.686932 59286 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0127 16:43:01.687533 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.687717 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.687823 59286 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0127 16:43:01.687869 59286 api.go:53] PageSize not implemented W0127 16:43:01.687933 59286 api.go:53] PageSize not implemented I0127 16:43:01.693478 59286 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0127 16:43:01.693828 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.694037 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.694546 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.694630 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.694714 59286 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0127 16:43:01.695012 59286 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0127 16:43:01.695359 59286 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0127 16:43:01.702224 59286 target.go:111] Terraform output is in /tmp/test3550454885/out --- PASS: TestPrivateFlannel (1.59s) === RUN TestPrivateCalico I0127 16:43:01.707202 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:01.707325 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:01.707367 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:01.707452 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:01.707491 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:01.707539 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:01.707580 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:01.707611 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:01.707650 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:01.707679 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:01.741200 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:43:01.745885 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.745983 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:01.746043 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.191252 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:03.643346 59286 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0127 16:43:03.647912 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:03.647968 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:03.648078 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:03.651247 59286 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0127 16:43:03.654949 59286 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0127 16:43:03.655496 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.655656 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.655902 59286 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0127 16:43:03.655987 59286 api.go:53] PageSize not implemented W0127 16:43:03.656086 59286 api.go:53] PageSize not implemented I0127 16:43:03.661847 59286 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0127 16:43:03.662033 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.662242 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.662748 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.662846 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.662928 59286 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0127 16:43:03.663282 59286 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0127 16:43:03.663659 59286 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0127 16:43:03.670921 59286 target.go:111] Terraform output is in /tmp/test3118810589/out --- PASS: TestPrivateCalico (1.97s) === RUN TestPrivateCilium I0127 16:43:03.676606 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:03.676740 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:03.676781 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:03.676830 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:03.676869 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:03.676919 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:03.677001 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:03.677030 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:03.677069 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:03.677098 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:03.706380 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:03.712029 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.712282 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:03.712501 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.026879 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:05.260390 59286 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0127 16:43:05.261358 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:05.261392 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:05.261475 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:05.265004 59286 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0127 16:43:05.271705 59286 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0127 16:43:05.272256 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.272447 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.272565 59286 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0127 16:43:05.272719 59286 api.go:53] PageSize not implemented W0127 16:43:05.272846 59286 api.go:53] PageSize not implemented I0127 16:43:05.278252 59286 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0127 16:43:05.278425 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.278655 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.279109 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.279215 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.279382 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:43:05.279889 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:43:05.280350 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:43:05.287045 59286 target.go:111] Terraform output is in /tmp/test3369425035/out --- PASS: TestPrivateCilium (1.62s) === RUN TestPrivateCilium2 I0127 16:43:05.291927 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:05.292052 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:05.292095 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:05.292179 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:05.292221 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:05.292274 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:05.292318 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:05.292349 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:05.292386 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:05.292416 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:05.320621 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:43:05.323711 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.323783 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:05.323831 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:06.648099 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:07.342948 59286 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0127 16:43:07.344064 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:07.344143 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:07.345682 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:07.351327 59286 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0127 16:43:07.354543 59286 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0127 16:43:07.355119 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.355309 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.355441 59286 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0127 16:43:07.355656 59286 api.go:53] PageSize not implemented W0127 16:43:07.355717 59286 api.go:53] PageSize not implemented I0127 16:43:07.361680 59286 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0127 16:43:07.361958 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.362091 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.362475 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.362867 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.362984 59286 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0127 16:43:07.363321 59286 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0127 16:43:07.363667 59286 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0127 16:43:07.371296 59286 target.go:111] Terraform output is in /tmp/test2851334292/out --- PASS: TestPrivateCilium2 (2.09s) === RUN TestPrivateCiliumAdvanced I0127 16:43:07.378758 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:07.378896 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:07.378940 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:07.378988 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:07.379029 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:07.379082 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:07.379167 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:07.379196 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:07.379237 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:07.379267 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:07.420196 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:07.424057 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.424153 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:07.424214 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:08.768904 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:09.004382 59286 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0127 16:43:09.004932 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:09.006068 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:09.006191 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:09.014155 59286 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0127 16:43:09.017901 59286 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0127 16:43:09.018274 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.018471 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.018828 59286 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0127 16:43:09.019034 59286 api.go:53] PageSize not implemented W0127 16:43:09.019079 59286 api.go:53] PageSize not implemented I0127 16:43:09.025679 59286 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0127 16:43:09.025991 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.026232 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.026570 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.027049 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.027172 59286 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0127 16:43:09.027470 59286 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0127 16:43:09.027825 59286 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0127 16:43:09.034998 59286 target.go:111] Terraform output is in /tmp/test1296593332/out --- PASS: TestPrivateCiliumAdvanced (1.66s) === RUN TestPrivateCiliumENI I0127 16:43:09.040238 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:09.040366 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:09.040412 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:09.040461 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:09.040500 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:09.040552 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:09.040640 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:09.040669 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:09.040706 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:09.040737 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:09.068719 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:09.072001 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.072082 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:09.072132 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.414925 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:10.647175 59286 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0127 16:43:10.648404 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:10.648451 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:10.648602 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:10.651030 59286 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0127 16:43:10.658935 59286 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0127 16:43:10.659383 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.659589 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.660264 59286 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0127 16:43:10.660335 59286 api.go:53] PageSize not implemented W0127 16:43:10.660510 59286 api.go:53] PageSize not implemented I0127 16:43:10.666137 59286 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0127 16:43:10.666396 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.666564 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.666986 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.667130 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.667299 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:43:10.667813 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:43:10.668115 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:43:10.674906 59286 target.go:111] Terraform output is in /tmp/test2586635718/out --- PASS: TestPrivateCiliumENI (1.64s) === RUN TestPrivateCanal I0127 16:43:10.679753 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:10.679893 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:10.679934 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:10.680018 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:10.680059 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:10.680107 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:10.680151 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:10.680179 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:10.680216 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:10.680242 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:10.708260 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:43:10.711621 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.711699 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:10.711758 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.205020 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:12.671049 59286 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0127 16:43:12.671717 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:12.671776 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:12.671935 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:12.674678 59286 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0127 16:43:12.678342 59286 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0127 16:43:12.679103 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.679331 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.680231 59286 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0127 16:43:12.680328 59286 api.go:53] PageSize not implemented W0127 16:43:12.680553 59286 api.go:53] PageSize not implemented I0127 16:43:12.689072 59286 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0127 16:43:12.689362 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.689504 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.690039 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.690132 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.690243 59286 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0127 16:43:12.690554 59286 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0127 16:43:12.690879 59286 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0127 16:43:12.708896 59286 target.go:111] Terraform output is in /tmp/test3717312647/out --- PASS: TestPrivateCanal (2.04s) === RUN TestPrivateKopeio I0127 16:43:12.716091 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:12.716224 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:12.716271 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:12.716322 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:12.716364 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:12.716421 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:12.716503 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:12.716555 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:12.716601 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:12.716630 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:12.746768 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:12.750443 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.750523 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:12.750585 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.087515 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:14.283541 59286 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0127 16:43:14.283968 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:14.284008 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:14.284104 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:14.286506 59286 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0127 16:43:14.289841 59286 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0127 16:43:14.290254 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.290471 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.290879 59286 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0127 16:43:14.290948 59286 api.go:53] PageSize not implemented W0127 16:43:14.291113 59286 api.go:53] PageSize not implemented I0127 16:43:14.296244 59286 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0127 16:43:14.296408 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.296657 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.297109 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.297204 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.297296 59286 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0127 16:43:14.297643 59286 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0127 16:43:14.298025 59286 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0127 16:43:14.305076 59286 target.go:111] Terraform output is in /tmp/test3826426925/out --- PASS: TestPrivateKopeio (1.60s) === RUN TestUnmanaged I0127 16:43:14.314763 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:14.314922 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:14.314967 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:14.315020 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:14.315063 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:14.315119 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:14.315206 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:14.315236 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:14.315276 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:14.315305 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:14.346041 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:14.349610 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.349696 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:14.349759 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.680670 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:15.855824 59286 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0127 16:43:15.856454 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:15.856509 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:15.856668 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:15.865629 59286 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0127 16:43:15.869160 59286 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0127 16:43:15.869840 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.870064 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.870181 59286 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0127 16:43:15.870258 59286 api.go:53] PageSize not implemented W0127 16:43:15.870404 59286 api.go:53] PageSize not implemented I0127 16:43:15.876227 59286 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0127 16:43:15.876460 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.876799 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.877003 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.877523 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.877627 59286 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0127 16:43:15.877953 59286 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0127 16:43:15.878281 59286 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0127 16:43:15.884758 59286 target.go:111] Terraform output is in /tmp/test3917375957/out --- PASS: TestUnmanaged (1.57s) === RUN TestPrivateSharedSubnet I0127 16:43:15.889444 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:15.889573 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:15.889617 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:15.889666 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:15.889713 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:15.889780 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:15.889885 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:15.889918 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:15.889957 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:15.889990 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:15.919015 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:15.922391 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.922472 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:15.922527 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.275481 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:17.462081 59286 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0127 16:43:17.463021 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:17.463052 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:17.463150 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:17.466488 59286 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0127 16:43:17.466962 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:17.469735 59286 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0127 16:43:17.470168 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.470327 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.470582 59286 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0127 16:43:17.470659 59286 api.go:53] PageSize not implemented W0127 16:43:17.470905 59286 api.go:53] PageSize not implemented I0127 16:43:17.476539 59286 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0127 16:43:17.476891 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.477103 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.477640 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.477743 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.477836 59286 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0127 16:43:17.478201 59286 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0127 16:43:17.478546 59286 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0127 16:43:17.485224 59286 target.go:111] Terraform output is in /tmp/test462058218/out --- PASS: TestPrivateSharedSubnet (1.60s) === RUN TestPrivateSharedIP I0127 16:43:17.489834 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:17.489985 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:17.490031 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:17.490078 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:17.490117 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:17.490169 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:17.490251 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:17.490280 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:17.490317 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:17.490343 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:17.524172 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:17.527719 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.527821 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:17.527897 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:18.865214 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:19.047180 59286 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0127 16:43:19.047609 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:19.047657 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:19.047759 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:19.051046 59286 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0127 16:43:19.051780 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:19.054496 59286 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0127 16:43:19.054935 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.055121 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.055298 59286 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0127 16:43:19.055459 59286 api.go:53] PageSize not implemented W0127 16:43:19.055654 59286 api.go:53] PageSize not implemented I0127 16:43:19.061138 59286 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0127 16:43:19.061330 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.061531 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.061816 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.062330 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.062454 59286 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0127 16:43:19.062808 59286 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0127 16:43:19.063183 59286 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0127 16:43:19.070115 59286 target.go:111] Terraform output is in /tmp/test2071198502/out --- PASS: TestPrivateSharedIP (1.58s) === RUN TestPrivateDns1 I0127 16:43:19.074894 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:19.075020 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:19.075065 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:19.075113 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:19.075155 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:19.075211 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:19.075297 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:19.075328 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:19.075368 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:19.075396 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0127 16:43:19.111864 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.111960 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:19.112024 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.727167 59286 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0127 16:43:20.731394 59286 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0127 16:43:20.731783 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0127 16:43:20.731820 59286 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0127 16:43:20.731891 59286 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0127 16:43:20.731903 59286 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0127 16:43:20.733138 59286 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0127 16:43:20.735961 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.736648 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.740398 59286 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0127 16:43:20.740489 59286 api.go:53] PageSize not implemented W0127 16:43:20.740721 59286 api.go:53] PageSize not implemented I0127 16:43:20.746398 59286 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0127 16:43:20.746682 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.746921 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.747301 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.747719 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.747918 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:43:20.748387 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:43:20.748750 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0127 16:43:20.755774 59286 target.go:111] Terraform output is in /tmp/test3842007710/out --- PASS: TestPrivateDns1 (1.68s) === RUN TestPrivateDns2 I0127 16:43:20.759285 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:20.759362 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:20.759390 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:20.759419 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:20.759444 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:20.759476 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:20.759527 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:20.759545 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:20.759571 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:20.759590 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:20.781739 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.781816 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:20.781866 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.305162 59286 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0127 16:43:22.308903 59286 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0127 16:43:22.309339 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:22.309505 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0127 16:43:22.309551 59286 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0127 16:43:22.309639 59286 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0127 16:43:22.309659 59286 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0127 16:43:22.309749 59286 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0127 16:43:22.310276 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.310512 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.312736 59286 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0127 16:43:22.312815 59286 api.go:53] PageSize not implemented W0127 16:43:22.312908 59286 api.go:53] PageSize not implemented I0127 16:43:22.318448 59286 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0127 16:43:22.318787 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.319066 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.319561 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.319658 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.319756 59286 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0127 16:43:22.320154 59286 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0127 16:43:22.320539 59286 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0127 16:43:22.331335 59286 target.go:111] Terraform output is in /tmp/test1378021009/out --- PASS: TestPrivateDns2 (1.58s) === RUN TestDiscoveryFeatureGate I0127 16:43:22.336577 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:22.336701 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:22.336741 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:22.336831 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:22.336875 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:22.336925 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:22.336966 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:22.336994 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:22.337030 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:22.337056 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:22.363469 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:43:22.366882 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:22.366966 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:23.695467 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:23.922591 59286 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0127 16:43:23.923030 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:23.923054 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:23.923132 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:23.926493 59286 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0127 16:43:23.935966 59286 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0127 16:43:23.936517 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:23.936763 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:23.937066 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:23.937533 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:23.937649 59286 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0127 16:43:23.938040 59286 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0127 16:43:23.938382 59286 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0127 16:43:23.945263 59286 target.go:111] Terraform output is in /tmp/test4099868134/out --- PASS: TestDiscoveryFeatureGate (1.61s) === RUN TestVFSServiceAccountIssuerDiscovery I0127 16:43:23.950914 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:23.951037 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:23.951079 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:23.951125 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:23.951163 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:23.951213 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:23.951297 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:23.951327 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:23.951366 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:23.951395 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:23.976379 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:23.979421 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:23.979501 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:25.282936 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:25.468649 59286 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0127 16:43:25.472497 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:25.472529 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:25.472619 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:25.474615 59286 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0127 16:43:25.480565 59286 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0127 16:43:25.481206 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:25.481539 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:25.481723 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:25.482308 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:25.482427 59286 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0127 16:43:25.482755 59286 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0127 16:43:25.483139 59286 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0127 16:43:25.488868 59286 target.go:111] Terraform output is in /tmp/test1269524170/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.54s) === RUN TestAWSLBController I0127 16:43:25.493577 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:25.493699 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:25.493739 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:25.493784 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:25.493825 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:25.493875 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:25.493953 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:25.493985 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:25.494026 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:25.494054 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:25.524555 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:25.527902 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:25.527993 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:26.872129 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:27.602780 59286 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0127 16:43:27.603108 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:27.603133 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:27.603210 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:27.611554 59286 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0127 16:43:27.617560 59286 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0127 16:43:27.617919 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:27.618255 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:27.618672 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:27.618783 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:27.618926 59286 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0127 16:43:27.619224 59286 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0127 16:43:27.619568 59286 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0127 16:43:27.626612 59286 target.go:111] Terraform output is in /tmp/test2929201414/out --- PASS: TestAWSLBController (2.15s) === RUN TestManyAddons I0127 16:43:27.640906 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:27.641056 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:27.641103 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:27.641153 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:27.641198 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:27.641252 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:27.641340 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:27.641369 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:27.641407 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:27.641436 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:27.670872 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:27.674565 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:27.674693 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:29.016198 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:29.872542 59286 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0127 16:43:29.874382 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:29.874425 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:29.874551 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:29.877327 59286 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0127 16:43:29.883574 59286 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0127 16:43:29.884132 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:29.884360 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:29.884640 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:29.885118 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:29.885234 59286 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0127 16:43:29.885574 59286 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0127 16:43:29.885923 59286 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0127 16:43:29.895497 59286 target.go:111] Terraform output is in /tmp/test3663759417/out --- PASS: TestManyAddons (2.26s) === RUN TestManyAddonsCCMIRSA I0127 16:43:29.904358 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:29.904499 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:29.904546 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:29.904595 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:29.904641 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:29.904696 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:29.904783 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:29.904812 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:29.904870 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:29.904920 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:29.934206 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:29.937607 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:29.937688 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:31.286251 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:32.176026 59286 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0127 16:43:32.177904 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:32.177930 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:32.178157 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:32.185613 59286 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0127 16:43:32.191806 59286 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0127 16:43:32.192123 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:32.192427 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:32.192651 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:32.193232 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:32.193347 59286 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0127 16:43:32.193673 59286 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0127 16:43:32.194042 59286 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0127 16:43:32.204780 59286 target.go:111] Terraform output is in /tmp/test1162336151/out --- PASS: TestManyAddonsCCMIRSA (2.31s) === RUN TestManyAddonsCCMIRSA23 I0127 16:43:32.216879 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:32.217021 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:32.217069 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:32.217164 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:32.217208 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:32.217261 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:32.217307 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:32.217336 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:32.217377 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:32.217407 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:32.245550 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0127 16:43:32.248684 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:32.248762 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:33.593943 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:34.520836 59286 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0127 16:43:34.522364 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:34.522407 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:34.522553 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:34.526306 59286 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0127 16:43:34.532806 59286 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0127 16:43:34.533439 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:34.533651 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:34.534037 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:34.534145 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:34.534269 59286 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0127 16:43:34.534561 59286 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0127 16:43:34.534820 59286 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0127 16:43:34.542690 59286 target.go:111] Terraform output is in /tmp/test3949957356/out --- PASS: TestManyAddonsCCMIRSA23 (2.34s) === RUN TestManyAddonsCCMIRSA24 I0127 16:43:34.558293 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:34.558443 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:34.558491 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:34.558619 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:34.558705 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:34.558808 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:34.558890 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:34.558923 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:34.558961 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:34.558991 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:34.587027 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:43:34.590857 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:34.590950 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:35.915508 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:36.807467 59286 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0127 16:43:36.810511 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:36.810550 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:36.810637 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:36.813559 59286 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0127 16:43:36.824261 59286 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0127 16:43:36.824895 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:36.825098 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:36.825446 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:36.825827 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:36.826005 59286 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0127 16:43:36.826481 59286 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0127 16:43:36.826981 59286 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0127 16:43:36.834881 59286 target.go:111] Terraform output is in /tmp/test2311513582/out --- PASS: TestManyAddonsCCMIRSA24 (2.29s) === RUN TestManyAddonsCCMIRSA25 I0127 16:43:36.844400 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:36.844543 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:36.844592 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:36.844684 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:36.844727 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:36.844780 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:36.844828 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:36.844858 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:36.844898 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:36.844927 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:36.872785 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:43:36.876005 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:36.876089 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:38.228399 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:39.147182 59286 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0127 16:43:39.147389 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:39.147407 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:39.147463 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:39.157929 59286 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0127 16:43:39.164937 59286 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0127 16:43:39.165460 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:39.165691 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:39.166262 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:39.166369 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:39.166462 59286 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0127 16:43:39.166908 59286 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0127 16:43:39.167266 59286 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0127 16:43:39.180234 59286 target.go:111] Terraform output is in /tmp/test3542088094/out --- PASS: TestManyAddonsCCMIRSA25 (2.35s) === RUN TestManyAddonsCCMIRSA26 I0127 16:43:39.191621 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:39.191747 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:39.191791 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:39.191886 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:39.191931 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:39.191985 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:39.192029 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:39.192058 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:39.192094 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:39.192130 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:39.220411 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:43:39.223509 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:39.223584 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:40.569891 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:41.444030 59286 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0127 16:43:41.446198 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:41.446238 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:41.446331 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:41.449841 59286 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0127 16:43:41.456531 59286 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0127 16:43:41.456776 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:41.457186 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:41.457467 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:41.457976 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:41.458095 59286 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0127 16:43:41.458815 59286 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0127 16:43:41.459113 59286 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0127 16:43:41.470218 59286 target.go:111] Terraform output is in /tmp/test708918829/out --- PASS: TestManyAddonsCCMIRSA26 (2.29s) === RUN TestManyAddonsGCE I0127 16:43:41.481400 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:43:43.737516 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:43:43.737602 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:43:43.737735 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0127 16:43:43.737775 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0127 16:43:43.737797 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0127 16:43:43.737858 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:43:43.738963 59286 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0127 16:43:43.744004 59286 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0127 16:43:43.753147 59286 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0127 16:43:43.754437 59286 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0127 16:43:43.754795 59286 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0127 16:43:43.759639 59286 target.go:111] Terraform output is in /tmp/test3112447812/out --- PASS: TestManyAddonsGCE (2.29s) === RUN TestCCM I0127 16:43:43.767288 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:43.767424 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:43.767473 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:43.767566 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:43.767610 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:43.767665 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:43.767710 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:43.767739 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:43.767777 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:43.767807 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:43.795404 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:43.798884 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:43.798974 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:45.143017 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:45.942385 59286 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0127 16:43:45.943380 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:45.943403 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:45.943468 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:45.946725 59286 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0127 16:43:45.950236 59286 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0127 16:43:45.950367 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:45.950706 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:45.951065 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:45.951295 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:45.951422 59286 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0127 16:43:45.951730 59286 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0127 16:43:45.952087 59286 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0127 16:43:45.962920 59286 target.go:111] Terraform output is in /tmp/test1000356499/out --- PASS: TestCCM (2.21s) === RUN TestExternalDNS I0127 16:43:45.972936 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:45.973066 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:45.973111 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:45.973163 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:45.973232 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:45.973285 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:45.973372 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:45.973401 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:45.973441 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:45.973469 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:45.998793 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:46.001929 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:46.002013 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:47.303105 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:47.488944 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:43:47.490144 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:47.490179 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:47.490263 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:47.492421 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:43:47.498624 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:43:47.499207 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:47.499433 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:47.499950 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:47.500047 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:47.500149 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:43:47.500475 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:43:47.500862 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:43:47.506027 59286 target.go:111] Terraform output is in /tmp/test17813033/out --- PASS: TestExternalDNS (1.54s) === RUN TestExternalDNSIRSA I0127 16:43:47.510532 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:47.510661 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:47.510706 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:47.510752 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:47.510791 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:47.510847 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:47.510929 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:47.510959 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:47.510999 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:47.511028 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:47.536293 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:47.543652 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:47.543786 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:48.851012 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:49.070993 59286 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0127 16:43:49.074460 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:49.074502 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:49.074633 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:49.076337 59286 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0127 16:43:49.082689 59286 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0127 16:43:49.083065 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:49.083252 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:49.083705 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:49.083908 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:49.084043 59286 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0127 16:43:49.084348 59286 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0127 16:43:49.084750 59286 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0127 16:43:49.090955 59286 target.go:111] Terraform output is in /tmp/test3169883373/out --- PASS: TestExternalDNSIRSA (1.59s) === RUN TestKarpenter I0127 16:43:49.100599 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:49.100740 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:49.100783 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:49.100833 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:49.100876 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:49.100928 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:49.101008 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:49.101037 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:49.101073 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:49.101101 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:49.133071 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:43:49.136840 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:49.136912 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:49.136965 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.458636 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:50.660801 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.660947 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.661063 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0127 16:43:50.792960 59286 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0127 16:43:50.793016 59286 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0127 16:43:50.793028 59286 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0127 16:43:50.793037 59286 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0127 16:43:50.793046 59286 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0127 16:43:50.823447 59286 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0127 16:43:50.823782 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:50.823812 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:50.823907 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:50.827650 59286 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0127 16:43:50.833530 59286 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0127 16:43:50.833753 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.834169 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.835738 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.836062 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.836340 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.836537 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.836708 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.837063 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.837242 59286 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0127 16:43:50.839202 59286 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0127 16:43:50.839544 59286 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0127 16:43:50.847860 59286 target.go:111] Terraform output is in /tmp/test3480245758/out --- PASS: TestKarpenter (1.75s) === RUN TestSharedSubnet I0127 16:43:50.854549 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:50.854675 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:50.854717 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:50.854803 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:50.854849 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:50.854904 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:50.854948 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:50.854977 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:50.855016 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:50.855048 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:50.880225 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:50.883240 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:50.883316 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:52.193736 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:52.373665 59286 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0127 16:43:52.374622 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:52.374658 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:52.374745 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:52.377557 59286 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0127 16:43:52.377951 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:52.383741 59286 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0127 16:43:52.383964 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:52.384419 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:52.384515 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:52.385142 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:52.385237 59286 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0127 16:43:52.385577 59286 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0127 16:43:52.385902 59286 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0127 16:43:52.390873 59286 target.go:111] Terraform output is in /tmp/test645829124/out --- PASS: TestSharedSubnet (1.54s) === RUN TestSharedVPC I0127 16:43:52.395316 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:52.395442 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:52.395486 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:52.395538 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:52.395579 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:52.395631 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:52.395717 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:52.395745 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:52.395783 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:52.395813 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:52.425320 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:52.428553 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:52.428652 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:53.788568 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:53.961753 59286 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0127 16:43:53.966248 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:53.966308 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:53.966410 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:53.970502 59286 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0127 16:43:53.971046 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:53.975895 59286 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0127 16:43:53.976605 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:53.976864 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:53.977140 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:53.977594 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:53.977730 59286 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0127 16:43:53.978092 59286 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0127 16:43:53.978470 59286 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0127 16:43:53.983658 59286 target.go:111] Terraform output is in /tmp/test2449531896/out --- PASS: TestSharedVPC (1.59s) === RUN TestSharedVPCIPv6 I0127 16:43:53.988557 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:53.988677 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:53.988717 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:53.988798 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:53.988841 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:53.988890 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:53.988933 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:53.988963 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:53.988999 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:53.989029 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:53.991090 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:43:53.991149 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:54.014333 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:43:54.014373 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:54.014441 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:43:54.017194 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:54.017255 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.344424 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:55.544435 59286 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0127 16:43:55.546010 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:55.546042 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:55.546138 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:55.547645 59286 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0127 16:43:55.548275 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:55.548422 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:43:55.550976 59286 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0127 16:43:55.551863 59286 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0127 16:43:55.551925 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:43:55.551988 59286 loadbalancers.go:35] PageSize not implemented I0127 16:43:55.552094 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:43:55.552176 59286 loadbalancers.go:35] PageSize not implemented I0127 16:43:55.561952 59286 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0127 16:43:55.562280 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.562506 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.562797 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.563294 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.563414 59286 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0127 16:43:55.563746 59286 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0127 16:43:55.564088 59286 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0127 16:43:55.571173 59286 target.go:111] Terraform output is in /tmp/test447558473/out --- PASS: TestSharedVPCIPv6 (1.59s) === RUN TestExistingIAM I0127 16:43:55.576072 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:55.576203 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:55.576245 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:55.576294 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:55.576335 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:55.576391 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:55.576473 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:55.576502 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:55.576570 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:55.576601 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:55.609872 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:55.613083 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.613167 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.613264 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:55.613316 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:56.943112 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:57.128740 59286 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0127 16:43:57.129189 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:43:57.129235 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:43:57.129335 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:43:57.136798 59286 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0127 16:43:57.146956 59286 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0127 16:43:57.147289 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.147721 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.147930 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.148059 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.148178 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.148282 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.148605 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.149127 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.149253 59286 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0127 16:43:57.149703 59286 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0127 16:43:57.150173 59286 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0127 16:43:57.157014 59286 target.go:111] Terraform output is in /tmp/test482978511/out --- PASS: TestExistingIAM (1.59s) === RUN TestPhaseNetwork I0127 16:43:57.162078 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:57.162206 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:57.162250 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:57.162299 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:57.162343 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:57.162397 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:57.162446 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:57.162476 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:57.162514 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:57.162542 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:57.196770 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:57.200163 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.200259 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:57.200320 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:58.516153 59286 zones.go:93] ListHostedZonesPages { } I0127 16:43:58.711280 59286 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0127 16:43:58.711886 59286 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0127 16:43:58.712510 59286 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0127 16:43:58.712926 59286 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0127 16:43:58.713144 59286 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0127 16:43:58.713384 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:43:58.713479 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:43:58.713570 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0127 16:43:58.714559 59286 target.go:111] Terraform output is in /tmp/test2069782759/out --- PASS: TestPhaseNetwork (1.55s) === RUN TestExternalLoadBalancer I0127 16:43:58.715106 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:43:58.715236 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:43:58.715281 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:43:58.715378 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:43:58.715423 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:43:58.715476 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:43:58.715522 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:43:58.715551 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:43:58.715591 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:43:58.715622 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:43:58.745874 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:43:58.749390 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:43:58.749493 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.077023 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:00.260691 59286 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0127 16:44:00.264954 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:00.264995 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:00.265112 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:00.269251 59286 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0127 16:44:00.275111 59286 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0127 16:44:00.275468 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.275704 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.276260 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.276363 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.276453 59286 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0127 16:44:00.276818 59286 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0127 16:44:00.277152 59286 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0127 16:44:00.282541 59286 target.go:111] Terraform output is in /tmp/test3399370656/out --- PASS: TestExternalLoadBalancer (1.57s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0127 16:44:00.287201 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:00.287324 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:00.287364 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:00.287409 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:00.287460 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:00.287514 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:00.287592 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:00.287622 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:00.287659 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:00.287687 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:00.326438 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:00.330221 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.330320 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.330380 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.330437 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.330487 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.330530 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:00.330586 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:01.871607 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:02.064003 59286 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0127 16:44:02.066045 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:02.066078 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:02.066168 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:02.068313 59286 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0127 16:44:02.079114 59286 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0127 16:44:02.079457 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.079737 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.079948 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.080192 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.080459 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.080567 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.080673 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.080763 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.080851 59286 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0127 16:44:02.081204 59286 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0127 16:44:02.081589 59286 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0127 16:44:02.088881 59286 target.go:111] Terraform output is in /tmp/test208586917/out --- PASS: TestMixedInstancesASG (1.81s) === RUN TestMixedInstancesSpotASG I0127 16:44:02.094561 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:02.094689 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:02.094730 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:02.094779 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:02.094826 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:02.094875 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:02.094959 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:02.094990 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:02.095026 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:02.095053 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:02.134762 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:02.138538 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.138636 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.138695 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.138753 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.138803 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.138848 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:02.138890 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.450728 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:03.643735 59286 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0127 16:44:03.645421 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:03.645463 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:03.646450 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:03.651549 59286 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0127 16:44:03.658503 59286 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0127 16:44:03.658887 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.659031 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.659273 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.659460 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.659554 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.659833 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.659931 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.660098 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.660218 59286 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0127 16:44:03.660625 59286 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0127 16:44:03.661058 59286 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0127 16:44:03.668312 59286 target.go:111] Terraform output is in /tmp/test3845733692/out --- PASS: TestMixedInstancesSpotASG (1.58s) === RUN TestAdditionalObjects I0127 16:44:03.673928 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:03.674074 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:03.674117 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:03.674159 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:03.674197 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:03.674249 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:03.674332 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:03.674362 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:03.674400 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:03.674427 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:03.707337 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0127 16:44:03.710671 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:03.710770 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:05.031494 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:05.215202 59286 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0127 16:44:05.216027 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:05.216067 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:05.216173 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:05.220056 59286 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0127 16:44:05.226009 59286 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0127 16:44:05.226511 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:05.226756 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:05.227272 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:05.227378 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:05.227484 59286 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0127 16:44:05.228803 59286 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0127 16:44:05.229479 59286 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0127 16:44:05.239054 59286 target.go:111] Terraform output is in /tmp/test3068996227/out --- PASS: TestAdditionalObjects (1.57s) === RUN TestContainerd I0127 16:44:05.243577 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:05.243703 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:05.243744 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:05.243828 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:05.243874 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:05.243923 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:05.243967 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:05.243997 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:05.244034 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:05.244061 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:05.268608 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:05.271766 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:05.271853 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:06.581000 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:06.758729 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:44:06.759270 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:06.759322 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:06.759472 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:06.762497 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:44:06.768748 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:44:06.769031 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:06.769470 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:06.769804 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:06.769975 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:06.770094 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:44:06.770408 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:44:06.770763 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:44:06.776003 59286 target.go:111] Terraform output is in /tmp/test2481168153/out --- PASS: TestContainerd (1.54s) === RUN TestContainerdCustom I0127 16:44:06.780526 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:06.780646 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:06.780686 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:06.780728 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:06.780764 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:06.780817 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:06.780895 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:06.780923 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:06.780959 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:06.780990 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:06.807393 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:06.813731 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:06.813895 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:07.377908 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:07.560326 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:44:07.561906 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:07.561953 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:07.562136 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:07.563959 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:44:07.572507 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:44:07.573815 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:07.573982 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:07.574406 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:07.574795 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:07.574924 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:44:07.575313 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:44:07.575722 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:44:07.581229 59286 target.go:111] Terraform output is in /tmp/test1987597145/out --- PASS: TestContainerdCustom (0.81s) === RUN TestDockerCustom I0127 16:44:07.585906 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:07.586028 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:07.586069 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:07.586154 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:07.586211 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:07.586263 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:07.586308 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:07.586338 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:07.586375 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:07.586403 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:07.612698 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0127 16:44:07.616071 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:07.616149 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.182523 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:08.350114 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:44:08.352371 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:08.352412 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:08.352525 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:08.358861 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:44:08.365560 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:44:08.366081 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.366279 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.366760 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.367095 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.367223 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:44:08.367578 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:44:08.367913 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:44:08.373077 59286 target.go:111] Terraform output is in /tmp/test2303602204/out --- PASS: TestDockerCustom (0.79s) === RUN TestAPIServerNodes I0127 16:44:08.377629 59286 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0127 16:44:08.377660 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:08.377783 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:08.377827 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:08.377874 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:08.377911 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:08.377965 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:08.378047 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:08.378077 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:08.378114 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:08.378143 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:08.405389 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0127 16:44:08.412487 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.412585 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:08.412648 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:09.857743 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:10.054171 59286 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0127 16:44:10.057126 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:10.057177 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:10.057315 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:10.058693 59286 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0127 16:44:10.069482 59286 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0127 16:44:10.070181 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.070605 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.070953 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.071081 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.071216 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.071422 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.071544 59286 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0127 16:44:10.071908 59286 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0127 16:44:10.072179 59286 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0127 16:44:10.078517 59286 target.go:111] Terraform output is in /tmp/test2396768447/out I0127 16:44:10.083316 59286 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.71s) === RUN TestNTHIMDSProcessor I0127 16:44:10.083442 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:10.083591 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:10.083635 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:10.083682 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:10.083728 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:10.083780 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:10.083865 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:10.083895 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:10.083933 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:10.083962 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:10.109124 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:10.112843 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:10.112936 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:11.397822 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:11.578991 59286 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0127 16:44:11.582913 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:11.582967 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:11.583116 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:11.584420 59286 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0127 16:44:11.590102 59286 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0127 16:44:11.590427 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:11.590742 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:11.591052 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:11.591497 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:11.591602 59286 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0127 16:44:11.591901 59286 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0127 16:44:11.592210 59286 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0127 16:44:11.600797 59286 target.go:111] Terraform output is in /tmp/test696477486/out --- PASS: TestNTHIMDSProcessor (1.52s) === RUN TestNTHIMDSProcessorIRSA I0127 16:44:11.604864 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:11.604993 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:11.605037 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:11.605125 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:11.605169 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:11.605221 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:11.605267 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:11.605297 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:11.605336 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:11.605366 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:11.631795 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:11.635263 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:11.635354 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:13.011270 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:13.225059 59286 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0127 16:44:13.226574 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:13.226617 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:13.226729 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:13.230331 59286 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0127 16:44:13.240393 59286 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0127 16:44:13.240991 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:13.241311 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:13.241799 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:13.241902 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:13.242020 59286 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0127 16:44:13.242418 59286 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0127 16:44:13.242720 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:44:13.248534 59286 target.go:111] Terraform output is in /tmp/test4193688996/out --- PASS: TestNTHIMDSProcessorIRSA (1.65s) === RUN TestCustomIRSA I0127 16:44:13.253798 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:13.253939 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:13.253987 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:13.254035 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:13.254072 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:13.254129 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:13.254210 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:13.254241 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:13.254279 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:13.254306 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:13.286147 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:13.289538 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:13.289625 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:14.783694 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:15.480427 59286 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0127 16:44:15.485058 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:15.485123 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:15.485247 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:15.490812 59286 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0127 16:44:15.497146 59286 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0127 16:44:15.497534 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:15.497865 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:15.498146 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:15.498618 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:15.498738 59286 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0127 16:44:15.499051 59286 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0127 16:44:15.499420 59286 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0127 16:44:15.506025 59286 target.go:111] Terraform output is in /tmp/test780433289/out --- PASS: TestCustomIRSA (2.26s) === RUN TestClusterNameDigit I0127 16:44:15.514177 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:15.514326 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:15.514371 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:15.514419 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:15.514471 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:15.514526 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:15.514612 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:15.514642 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:15.514680 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:15.514710 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:15.549073 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:15.552612 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:15.552709 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:16.904298 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:17.104540 59286 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0127 16:44:17.106681 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:17.106727 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:17.106832 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:17.108602 59286 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0127 16:44:17.119755 59286 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0127 16:44:17.120400 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.120756 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.121495 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.121744 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.121863 59286 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0127 16:44:17.122253 59286 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0127 16:44:17.122599 59286 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0127 16:44:17.128262 59286 target.go:111] Terraform output is in /tmp/test159428423/out --- PASS: TestClusterNameDigit (1.62s) === RUN TestCASPriorityExpander I0127 16:44:17.133150 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:17.133287 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:17.133329 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:17.133379 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:17.133421 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:17.133469 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:17.133549 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:17.133579 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:17.133615 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:17.133645 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:17.163858 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:44:17.167213 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.167290 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.167339 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:17.167385 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0127 16:44:18.933344 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:19.139225 59286 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0127 16:44:19.143369 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:19.143414 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:19.143557 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:19.145465 59286 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0127 16:44:19.151565 59286 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0127 16:44:19.151928 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.152079 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.152252 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.152475 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.152682 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.152769 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.153068 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.153272 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.153394 59286 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0127 16:44:19.153893 59286 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0127 16:44:19.154509 59286 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0127 16:44:19.160791 59286 target.go:111] Terraform output is in /tmp/test2851220509/out --- PASS: TestCASPriorityExpander (2.04s) === RUN TestCASPriorityExpanderCustom I0127 16:44:19.170216 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:19.170357 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:19.170403 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:19.170453 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:19.170498 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:19.170563 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:19.170695 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:19.170748 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:19.170814 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:19.170867 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:44:19.203527 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0127 16:44:19.207299 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.207381 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.207433 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:19.207491 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0127 16:44:20.545876 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:20.757051 59286 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0127 16:44:20.759779 59286 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0127 16:44:20.759818 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:20.759949 59286 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0127 16:44:20.763423 59286 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0127 16:44:20.771313 59286 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0127 16:44:20.771769 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.772026 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.772257 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.772541 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.772798 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.772890 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.773019 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.773303 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.773413 59286 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0127 16:44:20.773841 59286 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0127 16:44:20.774250 59286 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0127 16:44:20.781206 59286 target.go:111] Terraform output is in /tmp/test4067049225/out --- PASS: TestCASPriorityExpanderCustom (1.62s) === RUN TestLifecycleMinimalAWS I0127 16:44:20.786553 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:20.786682 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:20.786721 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:20.786763 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:20.786804 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:20.786858 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:20.786901 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:20.786930 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:20.786967 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:20.786994 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0127 16:44:20.815864 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0127 16:44:20.819046 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:20.819141 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0127 16:44:22.379583 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:22.566975 59286 iamrole.go:89] ListRoles: { } I0127 16:44:22.568593 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:44:22.568893 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:22.569151 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.569265 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:44:22.569329 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:44:22.569381 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:22.569353 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:22.569437 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:22.569518 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:22.569556 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0127 16:44:22.569711 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:44:22.569720 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0127 16:44:22.569983 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0127 16:44:22.570074 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0127 16:44:22.570093 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:22.570364 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.570539 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:22.570594 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:22.570771 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:22.570977 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:22.571172 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:22.571249 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:22.571457 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:22.572267 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:44:22.572477 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0127 16:44:22.572611 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0127 16:44:22.572686 59286 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0127 16:44:22.572666 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:44:22.572738 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:44:22.572779 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0127 16:44:22.572877 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0127 16:44:22.572939 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:44:22.573026 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:22.573100 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.573287 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:22.573325 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:44:22.573385 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0127 16:44:22.573700 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] } I0127 16:44:22.573821 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:22.574039 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:22.574045 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0127 16:44:22.574308 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:22.574361 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0127 16:44:22.574613 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:22.574728 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:22.574820 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:22.574912 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:22.574960 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:44:22.575011 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:22.575085 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:22.575130 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:22.575176 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:22.575219 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:44:22.575690 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:44:22.580811 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:44:22.581777 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:22.581910 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" }] }] } I0127 16:44:22.582351 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.582674 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.582892 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:22.583053 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:22.583134 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:22.583355 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:22.583557 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.583774 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:44:22.583843 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.583982 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.584125 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:44:22.584173 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.584384 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:22.584499 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:22.584652 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.584866 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.585035 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.585194 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.585329 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.585464 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:44:22.585597 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0127 16:44:22.585728 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:22.585838 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:22.586381 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:44:22.586758 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:44:22.587114 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:44:22.587169 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:22.587205 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:22.587280 59286 dns.go:235] Pre-creating DNS records I0127 16:44:22.587311 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:22.593469 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0127 16:44:22.596475 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:22.596588 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0127 16:44:24.018437 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:24.193954 59286 iamrole.go:89] ListRoles: { } I0127 16:44:24.195089 59286 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0127 16:44:24.195732 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.196201 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.196814 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.197092 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.197205 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:24.197246 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:24.197319 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:24.197396 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:24.197467 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:24.199311 59286 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0127 16:44:24.199502 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:24.199733 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0127 16:44:24.199714 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.201351 59286 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0127 16:44:24.201379 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:24.201515 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.201749 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:24.201929 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.202228 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0127 16:44:24.202597 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0127 16:44:24.203059 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:24.203316 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:24.209953 59286 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0127 16:44:24.210385 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:24.210605 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:24.210708 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:24.210880 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:24.211071 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:24.211288 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:24.211484 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:24.212220 59286 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0127 16:44:24.212464 59286 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0127 16:44:24.212771 59286 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0127 16:44:24.215430 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:44:24.215494 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:24.215534 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:44:24.215568 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:44:24.215601 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:44:24.215633 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:44:24.215666 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:24.215701 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:44:24.215739 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:44:24.215778 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:44:24.215818 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:44:24.215849 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:44:24.215879 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:24.215914 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:44:24.215944 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:24.215980 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:24.216013 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:24.216048 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:44:24.216080 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:44:24.216111 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:44:24.216142 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:24.216179 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:24.216215 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:24.216249 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:44:24.217573 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:44:24.217661 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:44:24.217682 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:44:24.217726 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.217775 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0127 16:44:24.217831 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.217887 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.217931 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.217979 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.218019 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.218056 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0127 16:44:24.218102 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.218148 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:44:24.218188 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0127 16:44:24.218234 59286 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0127 16:44:24.218272 59286 api.go:53] PageSize not implemented I0127 16:44:24.218293 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:24.218319 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:24.218337 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:44:24.218368 59286 targetgroups.go:35] PageSize not implemented I0127 16:44:24.218386 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:44:24.218444 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:44:24.218485 59286 iamrole.go:89] ListRoles: { } I0127 16:44:24.218529 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:24.218557 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:24.218614 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:44:24.218658 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:24.218690 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:24.219229 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0127 16:44:24.219318 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-group:nodes.minimal.example.com ok I0127 16:44:24.219378 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0127 16:44:24.219419 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:24.219403 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0127 16:44:24.219514 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:44:24.219471 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0127 16:44:24.219430 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok W0127 16:44:24.219621 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:24.219632 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0127 16:44:24.219671 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:44:24.219691 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0127 16:44:24.219725 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:44:24.219774 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:24.219823 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0127 16:44:24.220050 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:24.220070 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0127 16:44:24.220120 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:44:24.220216 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:44:24.220248 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0127 16:44:24.220336 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0127 16:44:24.220355 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:44:24.220395 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0127 16:44:24.220443 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0127 16:44:24.220519 59286 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0127 16:44:24.220541 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:44:24.220574 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0127 16:44:24.220651 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:44:24.220741 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:44:24.220818 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.43s) === RUN TestLifecycleMinimalOpenstack I0127 16:44:24.221287 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0127 16:44:24.228818 59286 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:44:25.722143 59286 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0127 16:44:25.722185 59286 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0127 16:44:25.742660 59286 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2024/01/27 16:44:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0127 16:44:25.748358 59286 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0127 16:44:25.761900 59286 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0127 16:44:25.765856 59286 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2024/01/27 16:44:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0127 16:44:25.768656 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:25.768732 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:25.768950 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0127 16:44:26.774673 59286 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:44:28.247006 59286 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0127 16:44:28.247045 59286 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0127 16:44:28.269261 59286 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2024/01/27 16:44:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0127 16:44:28.275925 59286 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0127 16:44:28.287203 59286 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0127 16:44:28.289008 59286 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2024/01/27 16:44:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0127 16:44:28.292315 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:28.292620 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0127 16:44:28.293171 59286 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0127 16:44:28.294768 59286 delete_cluster.go:128] Looking for cloud resources to delete 2024/01/27 16:44:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:bbe52f51-61f7-40dc-8929-28bc06a645d9 ok SecurityGroup:7e54a086-2ea7-4258-a285-10ef7a055d63 ok Instance:cf62cc13-10cf-488e-b8f1-138338583eab ok SecurityGroup:e440e9fd-3c23-473a-b36d-f8dc7601ccef ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Port:a774bd2c-d318-46f9-8447-a4ef45f4d0ca ok Instance:981f484d-505f-473f-996d-d666ed3ff694 ok ServerGroup:1e7476e7-286b-4552-b799-c53f73eb0da4 ok Port:2881d371-da60-4e98-8d9c-a50d3330d0af ok Subnet:1b95dd73-b5cf-4391-a881-a8c14233d940 ok ServerGroup:1b6f4100-e9bc-4188-88d5-5b71612afc9c ok Network:96e07ac9-b4bc-400c-b9a7-7af2f4ec33f2 ok Instance:0d6ba5c2-f0ec-4d2e-900c-f7e86eacd017 ok Port:a64083d0-bf75-4875-bc40-2b2a3fe6a619 ok --- PASS: TestLifecycleMinimalOpenstack (5.19s) === RUN TestLifecycleMinimalGCE I0127 16:44:29.408716 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0127 16:44:29.410636 59286 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:44:31.183381 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:44:31.183483 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:44:31.183613 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0127 16:44:31.183649 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0127 16:44:31.183675 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0127 16:44:31.183747 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:44:31.185248 59286 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0127 16:44:31.189840 59286 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0127 16:44:31.195824 59286 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0127 16:44:31.197016 59286 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0127 16:44:31.197337 59286 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0127 16:44:31.197435 59286 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:44:32.964292 59286 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0127 16:44:32.964409 59286 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0127 16:44:32.964531 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0127 16:44:32.964567 59286 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0127 16:44:32.964593 59286 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0127 16:44:32.964665 59286 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0127 16:44:32.965858 59286 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0127 16:44:32.968799 59286 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0127 16:44:32.972164 59286 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0127 16:44:32.972891 59286 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0127 16:44:32.973015 59286 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0127 16:44:32.973969 59286 delete_cluster.go:128] Looking for cloud resources to delete I0127 16:44:32.974015 59286 gce.go:99] Scanning zones: [us-test1-a] I0127 16:44:32.974234 59286 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0127 16:44:32.974249 59286 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok InstanceTemplate:nodes-minimal-gce-example-com-1706373871 ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1706373871 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.57s) === RUN TestLifecycleFloatingIPOpenstack I0127 16:44:32.975152 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0127 16:44:32.981555 59286 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:44:34.447540 59286 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0127 16:44:34.447597 59286 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0127 16:44:34.465641 59286 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2024/01/27 16:44:34 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:34 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0127 16:44:34.470942 59286 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0127 16:44:34.484598 59286 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0127 16:44:34.488465 59286 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2024/01/27 16:44:34 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:34 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:34 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0127 16:44:34.491159 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:34.491459 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:34.491465 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0127 16:44:35.496781 59286 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0127 16:44:36.964273 59286 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0127 16:44:36.964326 59286 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0127 16:44:36.985721 59286 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2024/01/27 16:44:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0127 16:44:36.995953 59286 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0127 16:44:37.003161 59286 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0127 16:44:37.005061 59286 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2024/01/27 16:44:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/01/27 16:44:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0127 16:44:37.008691 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:37.008821 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0127 16:44:37.009119 59286 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0127 16:44:37.009471 59286 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0127 16:44:37.011134 59286 delete_cluster.go:128] Looking for cloud resources to delete 2024/01/27 16:44:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router-IF:888865ce-5000-4ea0-95ed-8a6c407e40ad ok Router:d4edd740-1e49-462c-938b-dcdebec2b573 ok Port:c3961549-be09-45f1-aea1-7c6459763faf ok Network:1d3c8005-203a-44ea-b61e-2792760042a0 ok ServerGroup:e08d0810-1fb7-4c1a-af48-953b112dd132 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Subnet:888865ce-5000-4ea0-95ed-8a6c407e40ad ok Instance:b1f80c56-cc9c-4b68-bad0-e5b0fa801f6f ok SecurityGroup:f5e4d37a-8843-465e-b943-1626df87c50b ok Port:e3aabef7-b0c5-4962-81eb-438843774636 ok Instance:4deeac98-a08a-4849-9876-d1e1f695ebe3 ok SecurityGroup:0eea7524-9e1a-4e9d-95c0-b60f88bbc47b ok Port:65e498d8-c3bc-4cb0-a1dd-515d074296d1 ok SecurityGroup:d0617e31-edc2-4924-b985-15106b1975d4 ok Port:7186dc87-fd4d-41af-b8d8-c7bc2c4cde20 ok ServerGroup:6cecc706-9c3a-4c76-a084-0eea171cd08f ok Instance:a3abf9f1-1c97-451f-8fb4-c59fbe0b2aa0 ok --- PASS: TestLifecycleFloatingIPOpenstack (5.15s) === RUN TestLifecyclePrivateCalico I0127 16:44:38.125091 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:38.125243 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:38.125286 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:38.125335 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:38.125377 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:38.125427 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:38.125468 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:38.125499 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:38.125536 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:38.125562 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0127 16:44:38.155020 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:44:38.158700 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:38.158793 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:38.158853 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.481225 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:39.936233 59286 iamrole.go:89] ListRoles: { } I0127 16:44:39.938506 59286 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0127 16:44:39.938841 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.939027 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0127 16:44:39.939030 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.939086 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.939153 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0127 16:44:39.939192 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:44:39.939231 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:44:39.939270 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:39.939323 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:39.939363 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.939542 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.939697 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:39.939760 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:39.939925 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0127 16:44:39.939965 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.939959 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:39.940030 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] } I0127 16:44:39.940133 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:39.940277 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:39.940213 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0127 16:44:39.940326 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.940352 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0127 16:44:39.940499 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:39.940627 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:39.942341 59286 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0127 16:44:39.942493 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0127 16:44:39.942561 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0127 16:44:39.942703 59286 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0127 16:44:39.942631 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0127 16:44:39.942787 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:39.942792 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0127 16:44:39.942912 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I0127 16:44:39.942878 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0127 16:44:39.943072 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:39.943028 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0127 16:44:39.943101 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0127 16:44:39.943154 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0127 16:44:39.943161 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.943244 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0127 16:44:39.943324 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0127 16:44:39.943412 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0127 16:44:39.943424 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:39.943497 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0127 16:44:39.943562 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0127 16:44:39.943461 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0127 16:44:39.943618 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:39.943675 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:44:39.943778 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] } I0127 16:44:39.943935 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.944168 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:39.944271 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:39.944324 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:39.944378 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0127 16:44:39.944689 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:39.944860 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.945038 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.945198 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:44:39.945208 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:39.945254 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:39.945410 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:39.945467 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0127 16:44:39.945581 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:39.945648 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.945780 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:39.945865 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:39.945924 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:44:39.946115 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0127 16:44:39.946174 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:39.946280 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:39.946362 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:39.946429 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:39.946486 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:39.946588 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:39.946730 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:44:39.946101 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0127 16:44:39.946794 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:44:39.946870 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:39.946938 59286 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] } I0127 16:44:39.947087 59286 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0127 16:44:39.947246 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:39.947452 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:44:39.947341 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } W0127 16:44:39.947542 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:39.947577 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0127 16:44:39.947565 59286 api.go:53] PageSize not implemented I0127 16:44:39.947769 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:44:39.947707 59286 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0127 16:44:39.947830 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:44:39.947892 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:39.947874 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:39.948006 59286 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatecalico.example.com" }] } I0127 16:44:39.948084 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:39.947963 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.948119 59286 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0127 16:44:39.947970 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0127 16:44:39.948207 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:39.948215 59286 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } W0127 16:44:39.948341 59286 api.go:53] PageSize not implemented I0127 16:44:39.948361 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:39.948374 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0127 16:44:39.948469 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0127 16:44:39.948541 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.948779 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:39.948885 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:39.948951 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0127 16:44:39.949118 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0127 16:44:39.949225 59286 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.949291 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.949427 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0127 16:44:39.949521 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0127 16:44:39.949564 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:44:39.949657 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.949785 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.949947 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:44:39.950045 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0127 16:44:39.950172 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.950300 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.950423 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.950555 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I0127 16:44:39.950687 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0127 16:44:39.950737 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.950870 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.950998 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.951130 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.951254 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.951385 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0127 16:44:39.951475 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.951601 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.951732 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.951878 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.952012 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" }] }] } I0127 16:44:39.952150 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0127 16:44:39.952278 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.952408 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.952507 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.952655 59286 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0127 16:44:39.952802 59286 api.go:53] PageSize not implemented I0127 16:44:39.952782 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:39.952847 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0127 16:44:39.952985 59286 api.go:53] PageSize not implemented I0127 16:44:39.952974 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:39.952898 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:39.953081 59286 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:39.953053 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:39.953254 59286 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0127 16:44:39.953383 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0127 16:44:39.953235 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:39.953431 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:39.953476 59286 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0127 16:44:39.953487 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:39.959669 59286 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0127 16:44:39.959803 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:39.960037 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0127 16:44:39.960235 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.960361 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.960503 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.960644 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.961162 59286 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0127 16:44:39.961448 59286 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0127 16:44:39.961821 59286 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0127 16:44:39.961874 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:39.961914 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:39.961981 59286 dns.go:235] Pre-creating DNS records I0127 16:44:39.962009 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:39.968686 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:44:39.972339 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.972426 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:39.972489 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.315672 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:41.746852 59286 iamrole.go:89] ListRoles: { } I0127 16:44:41.748168 59286 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0127 16:44:41.748381 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.748554 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.751960 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:41.752138 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.752519 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:41.752570 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:41.752621 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:41.752672 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:41.753133 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.756126 59286 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0127 16:44:41.756349 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0127 16:44:41.756249 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0127 16:44:41.756461 59286 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0127 16:44:41.756409 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0127 16:44:41.756452 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.756571 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0127 16:44:41.756563 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0127 16:44:41.756618 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.756655 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0127 16:44:41.756732 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:41.756768 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:41.756829 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0127 16:44:41.756933 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:41.756971 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:41.757024 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0127 16:44:41.757118 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:41.757150 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.757248 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:44:41.757317 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.757440 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.757562 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0127 16:44:41.757702 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:41.757772 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:41.758270 59286 executor.go:111] Tasks: 79 done / 142 total; 41 can run W0127 16:44:41.758537 59286 api.go:53] PageSize not implemented I0127 16:44:41.758498 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:41.758567 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.758557 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:44:41.758659 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0127 16:44:41.758675 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:41.758706 59286 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0127 16:44:41.758702 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0127 16:44:41.758653 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:41.758759 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0127 16:44:41.758796 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0127 16:44:41.758845 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0127 16:44:41.758881 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0127 16:44:41.758903 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0127 16:44:41.758984 59286 api.go:53] PageSize not implemented I0127 16:44:41.759002 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.759000 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:44:41.759054 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0127 16:44:41.759094 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0127 16:44:41.759387 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.759510 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.759693 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:41.759886 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:41.760252 59286 executor.go:111] Tasks: 120 done / 142 total; 6 can run I0127 16:44:41.760338 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:41.760429 59286 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" W0127 16:44:41.760387 59286 api.go:53] PageSize not implemented W0127 16:44:41.760468 59286 api.go:53] PageSize not implemented I0127 16:44:41.760473 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:41.760536 59286 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0127 16:44:41.760481 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:41.760529 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.760580 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:44:41.760696 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.760763 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.760961 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.766319 59286 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0127 16:44:41.766431 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.766582 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.766759 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.766902 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:41.767046 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.767553 59286 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0127 16:44:41.767660 59286 api.go:53] PageSize not implemented I0127 16:44:41.767684 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.767867 59286 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0127 16:44:41.768069 59286 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0127 16:44:41.771574 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:44:41.771653 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:41.771731 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:44:41.771799 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0127 16:44:41.771868 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:44:41.771935 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:44:41.771998 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:44:41.772068 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:41.772137 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:44:41.772203 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:44:41.772268 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:44:41.772336 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0127 16:44:41.772403 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0127 16:44:41.772465 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:44:41.772521 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:44:41.772580 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:41.772652 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:44:41.772705 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:41.772773 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:41.772833 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:41.772897 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:41.772958 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:44:41.773020 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:41.773081 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:44:41.773138 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:41.773225 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:44:41.773294 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:44:41.773354 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:41.773420 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:41.773490 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:41.773551 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:44:41.775176 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:44:41.775265 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:44:41.775297 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:44:41.775363 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.775447 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0127 16:44:41.775542 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.775631 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.775698 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.775783 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.775844 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.775914 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0127 16:44:41.776012 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.776086 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:41.776134 59286 natgateway.go:117] DescribeNatGateways: { } I0127 16:44:41.776193 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0127 16:44:41.776264 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0127 16:44:41.776345 59286 api.go:53] PageSize not implemented I0127 16:44:41.776374 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0127 16:44:41.776440 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:41.776480 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:41.776503 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0127 16:44:41.776596 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:44:41.776650 59286 targetgroups.go:35] PageSize not implemented I0127 16:44:41.776677 59286 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I0127 16:44:41.776761 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:44:41.776827 59286 iamrole.go:89] ListRoles: { } I0127 16:44:41.776901 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:41.776944 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:41.777015 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:44:41.777084 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:41.777149 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0127 16:44:41.777207 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:44:41.777263 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0127 16:44:41.777934 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:41.777984 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } autoscaling-group:bastion.privatecalico.example.com ok I0127 16:44:41.778068 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok iam-instance-profile:masters.privatecalico.example.com ok I0127 16:44:41.778068 59286 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I0127 16:44:41.778128 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0127 16:44:41.778181 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0127 16:44:41.778214 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0127 16:44:41.778178 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0127 16:44:41.778264 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok autoscaling-group:nodes.privatecalico.example.com ok I0127 16:44:41.778016 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } I0127 16:44:41.778321 59286 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } W0127 16:44:41.778358 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok iam-instance-profile:nodes.privatecalico.example.com ok I0127 16:44:41.778145 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatecalico.example.com. ok I0127 16:44:41.778392 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I0127 16:44:41.778479 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:41.778573 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0127 16:44:41.778811 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:41.778838 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0127 16:44:41.778879 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:44:41.778945 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:44:41.779008 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok I0127 16:44:41.779070 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0127 16:44:41.779132 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0127 16:44:41.779167 59286 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0127 16:44:41.779231 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:44:41.779298 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0127 16:44:41.779424 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-1 ok I0127 16:44:41.779477 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0127 16:44:41.779607 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0127 16:44:41.779612 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:44:41.779693 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0127 16:44:41.779755 59286 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0127 16:44:41.779823 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0127 16:44:41.779842 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I0127 16:44:41.779919 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } subnet:subnet-2 ok iam-role:nodes.privatecalico.example.com ok I0127 16:44:41.779993 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:41.779992 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0127 16:44:41.780082 59286 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0127 16:44:41.780110 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0127 16:44:41.780162 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0127 16:44:41.780056 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0127 16:44:41.780235 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:41.780261 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:44:41.780205 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0127 16:44:41.780334 59286 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0127 16:44:41.780356 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0127 16:44:41.780409 59286 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0127 16:44:41.780517 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:44:41.780588 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0127 16:44:41.780697 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:44:41.780805 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.66s) === RUN TestLifecyclePrivateKopeio I0127 16:44:41.781337 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:41.781496 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:41.781543 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:41.781615 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:41.781669 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:41.781749 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:41.781808 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:41.781862 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:41.781925 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:41.781969 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0127 16:44:41.811937 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:41.815640 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.815741 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:41.815842 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.122107 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:43.304575 59286 iamrole.go:89] ListRoles: { } I0127 16:44:43.306731 59286 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0127 16:44:43.306939 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.307059 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:43.307128 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.307242 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:43.307301 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] }] } I0127 16:44:43.307467 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:43.307592 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:43.307648 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:43.307790 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.307896 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0127 16:44:43.307942 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.308015 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0127 16:44:43.308092 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.308169 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:44:43.308199 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:44:43.308223 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:43.308257 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:43.308213 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0127 16:44:43.308287 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.308335 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0127 16:44:43.308422 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:43.308532 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:43.308544 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0127 16:44:43.308649 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0127 16:44:43.311309 59286 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0127 16:44:43.311546 59286 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0127 16:44:43.311520 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.311726 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.312142 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:44:43.312117 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0127 16:44:43.311944 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0127 16:44:43.311884 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:43.312484 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0127 16:44:43.312431 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0127 16:44:43.312308 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0127 16:44:43.312504 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0127 16:44:43.312644 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.313405 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0127 16:44:43.313398 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0127 16:44:43.313407 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0127 16:44:43.313551 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0127 16:44:43.313516 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:43.314393 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0127 16:44:43.314404 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:43.314465 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0127 16:44:43.314522 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:43.314545 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0127 16:44:43.314605 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.314628 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0127 16:44:43.314707 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0127 16:44:43.314847 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.314840 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:43.314953 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0127 16:44:43.315072 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.315173 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.315268 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0127 16:44:43.315380 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:43.315386 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:43.315482 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:43.315539 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:44:43.315595 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:44:43.315594 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:43.315632 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:43.315750 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:43.315820 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:43.315893 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:43.315942 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:43.315992 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.316078 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:43.316126 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:43.316219 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:43.316263 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:43.316305 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0127 16:44:43.316471 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:43.316461 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0127 16:44:43.316565 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:43.316668 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] } I0127 16:44:43.316306 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0127 16:44:43.316774 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:43.316823 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:43.316917 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:43.316974 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:43.317030 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0127 16:44:43.317074 59286 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0127 16:44:43.317163 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:43.317214 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:43.317259 59286 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0127 16:44:43.317335 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:44:43.317385 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:44:43.317437 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0127 16:44:43.317485 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0127 16:44:43.317571 59286 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0127 16:44:43.317742 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:43.317871 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:43.317974 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:43.317875 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0127 16:44:43.318057 59286 api.go:53] PageSize not implemented I0127 16:44:43.318123 59286 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0127 16:44:43.318190 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.318277 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:43.318385 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0127 16:44:43.318386 59286 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0127 16:44:43.318440 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0127 16:44:43.318454 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:43.318488 59286 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0127 16:44:43.318485 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0127 16:44:43.318547 59286 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0127 16:44:43.318708 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.318862 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.319007 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.319149 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0127 16:44:43.319324 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" }] }] } I0127 16:44:43.319555 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:43.319686 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:43.319805 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0127 16:44:43.319914 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0127 16:44:43.320072 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.320244 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:43.320392 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:43.320476 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0127 16:44:43.320517 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:44:43.320621 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0127 16:44:43.320699 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:43.320795 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0127 16:44:43.320831 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0127 16:44:43.320946 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.321080 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0127 16:44:43.321151 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:44:43.321193 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.321331 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0127 16:44:43.321474 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.321609 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.321733 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0127 16:44:43.321772 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.321910 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.322044 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.322151 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.322244 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.322378 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.322509 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.322633 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.322761 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0127 16:44:43.322904 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:44:43.322951 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:43.322990 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:43.323021 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0127 16:44:43.323084 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0127 16:44:43.323218 59286 api.go:53] PageSize not implemented I0127 16:44:43.323158 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:44:43.323241 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:43.323278 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0127 16:44:43.323377 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0127 16:44:43.323508 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0127 16:44:43.323549 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:44:43.323600 59286 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0127 16:44:43.323646 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:43.323704 59286 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0127 16:44:43.323795 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0127 16:44:43.323848 59286 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0127 16:44:43.323889 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:43.323928 59286 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0127 16:44:43.323972 59286 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0127 16:44:43.324012 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0127 16:44:43.324052 59286 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0127 16:44:43.324144 59286 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0127 16:44:43.324252 59286 api.go:53] PageSize not implemented I0127 16:44:43.324235 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:43.324276 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:43.324373 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-3" } I0127 16:44:43.324301 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:43.324431 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:43.324434 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:43.324557 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-2" } W0127 16:44:43.324579 59286 api.go:53] PageSize not implemented I0127 16:44:43.324638 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:43.324613 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:43.324738 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:43.330353 59286 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0127 16:44:43.330589 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.330703 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.330874 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.331001 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.331483 59286 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0127 16:44:43.331755 59286 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0127 16:44:43.332079 59286 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0127 16:44:43.332135 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:43.332182 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:43.332270 59286 dns.go:235] Pre-creating DNS records I0127 16:44:43.332301 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:43.338991 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:43.342580 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.342674 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:43.342757 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.681604 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:44.878545 59286 iamrole.go:89] ListRoles: { } I0127 16:44:44.880836 59286 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0127 16:44:44.881062 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:44.881798 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.881998 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] }] } I0127 16:44:44.882416 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:44.882585 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.882763 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:44.882800 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:44.882855 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:44.882897 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.884632 59286 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0127 16:44:44.884811 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0127 16:44:44.884766 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:44.884877 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.885040 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0127 16:44:44.885136 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0127 16:44:44.885135 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0127 16:44:44.885171 59286 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0127 16:44:44.885063 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] }] } I0127 16:44:44.885183 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0127 16:44:44.885323 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0127 16:44:44.885560 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:44.885627 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.885827 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:44.885891 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.886045 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:44.886085 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.886218 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:44.886259 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0127 16:44:44.886423 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:44.886484 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.886645 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0127 16:44:44.886818 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.886973 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0127 16:44:44.887144 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.887283 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:44.887392 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:44:44.887473 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0127 16:44:44.887519 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:44.887615 59286 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0127 16:44:44.887808 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0127 16:44:44.887830 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:44.887939 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:44.887941 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:44.887971 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0127 16:44:44.888035 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } W0127 16:44:44.888092 59286 api.go:53] PageSize not implemented I0127 16:44:44.888095 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0127 16:44:44.888081 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:44.888155 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0127 16:44:44.888134 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.888220 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0127 16:44:44.888192 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:44.888238 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.888454 59286 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0127 16:44:44.888482 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0127 16:44:44.888563 59286 api.go:53] PageSize not implemented I0127 16:44:44.888586 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.888634 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:44.888816 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.888923 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.888999 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0127 16:44:44.889287 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:44.889584 59286 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0127 16:44:44.889682 59286 api.go:53] PageSize not implemented I0127 16:44:44.889669 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:44.889722 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.889758 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:44.889787 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:44.889953 59286 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W0127 16:44:44.889894 59286 api.go:53] PageSize not implemented I0127 16:44:44.889987 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:44.890096 59286 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0127 16:44:44.890086 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.890308 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.890396 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.895436 59286 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0127 16:44:44.895571 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.895776 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.895883 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.896093 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.896997 59286 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0127 16:44:44.897137 59286 api.go:53] PageSize not implemented I0127 16:44:44.897173 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.897403 59286 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0127 16:44:44.897666 59286 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0127 16:44:44.901150 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:44:44.901217 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:44.901259 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:44:44.901293 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:44:44.901329 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:44:44.901368 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:44:44.901404 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:44.901442 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:44:44.901478 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:44:44.901519 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:44:44.901556 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0127 16:44:44.901599 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:44:44.901635 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:44:44.901674 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:44.901711 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:44:44.901745 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:44.901782 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0127 16:44:44.901819 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:44.901856 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:44.901892 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:44.901928 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:44:44.901963 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:44.902001 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:44:44.902034 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:44.902071 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:44.902111 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0127 16:44:44.902151 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:44:44.902184 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:44:44.902219 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:44.902256 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:44.902294 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:44.902329 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:44:44.903939 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:44:44.904014 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:44:44.904037 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:44:44.904083 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904149 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0127 16:44:44.904221 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904287 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904338 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904391 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904433 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904482 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0127 16:44:44.904551 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904617 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:44.904649 59286 natgateway.go:117] DescribeNatGateways: { } I0127 16:44:44.904686 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0127 16:44:44.904727 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0127 16:44:44.904779 59286 api.go:53] PageSize not implemented I0127 16:44:44.904797 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0127 16:44:44.904843 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:44.904870 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:44.904886 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0127 16:44:44.904924 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:44:44.904948 59286 targetgroups.go:35] PageSize not implemented I0127 16:44:44.904965 59286 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0127 16:44:44.905032 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:44:44.905076 59286 iamrole.go:89] ListRoles: { } I0127 16:44:44.905126 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:44.905156 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:44.905201 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:44:44.905252 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:44.905303 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I0127 16:44:44.905346 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0127 16:44:44.905379 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } autoscaling-config:lt-3 ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok autoscaling-config:lt-2 ok I0127 16:44:44.906109 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0127 16:44:44.906169 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok autoscaling-group:bastion.privatekopeio.example.com ok I0127 16:44:44.906212 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0127 16:44:44.906217 59286 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } autoscaling-group:nodes.privatekopeio.example.com ok I0127 16:44:44.906123 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0127 16:44:44.906235 59286 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0127 16:44:44.906354 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } I0127 16:44:44.906332 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } internet-gateway:igw-2 ok I0127 16:44:44.906166 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatekopeio.example.com. ok I0127 16:44:44.906275 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I0127 16:44:44.906416 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:44:44.906461 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0127 16:44:44.906510 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:44:44.906556 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I0127 16:44:44.906605 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:44:44.906669 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0127 16:44:44.906803 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:44.906821 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-1 ok I0127 16:44:44.906867 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:44.906914 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0127 16:44:44.907138 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:44.907159 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:44:44.907191 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:44.907244 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0127 16:44:44.907411 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:44.907442 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0127 16:44:44.907500 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0127 16:44:44.907589 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:44.907636 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0127 16:44:44.907636 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:44:44.907720 59286 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com W0127 16:44:44.907730 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:44.907744 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0127 16:44:44.907739 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0127 16:44:44.907792 59286 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0127 16:44:44.907799 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0127 16:44:44.907832 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0127 16:44:44.907924 59286 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0127 16:44:44.907934 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0127 16:44:44.908007 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0127 16:44:44.907943 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0127 16:44:44.908068 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0127 16:44:44.908079 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:44:44.908106 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0127 16:44:44.908152 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0127 16:44:44.908166 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0127 16:44:44.908194 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0127 16:44:44.908276 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:44:44.908341 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0127 16:44:44.908395 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0127 16:44:44.908481 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:44:44.908560 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (3.13s) === RUN TestLifecycleIPv6 I0127 16:44:44.909041 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:44.909177 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:44.909215 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:44.909255 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:44.909293 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:44.909345 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:44.909386 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:44.909415 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:44.909455 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:44.909482 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0127 16:44:44.943740 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:44:44.947951 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:44.948054 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:46.265839 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:46.446907 59286 iamrole.go:89] ListRoles: { } I0127 16:44:46.448335 59286 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0127 16:44:46.449724 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:46.449925 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.450446 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0127 16:44:46.450532 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0127 16:44:46.451082 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.451409 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:46.451710 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:46.451952 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0127 16:44:46.452104 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0127 16:44:46.453718 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.454630 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:46.454838 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.455552 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.455783 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.456015 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:46.456180 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:46.456252 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:44:46.456291 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:44:46.456320 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:46.456373 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:46.456434 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.456631 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:46.457233 59286 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0127 16:44:46.457381 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.457433 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0127 16:44:46.457502 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:44:46.457541 59286 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0127 16:44:46.457642 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0127 16:44:46.457633 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0127 16:44:46.457604 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0127 16:44:46.457761 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0127 16:44:46.457630 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0127 16:44:46.457806 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0127 16:44:46.457838 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0127 16:44:46.457855 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0127 16:44:46.458079 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:46.458209 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:46.458102 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0127 16:44:46.458262 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:46.458335 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.458530 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:46.458714 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:44:46.458764 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:46.458872 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0127 16:44:46.459002 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.459129 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.459237 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.459359 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:46.459445 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0127 16:44:46.459541 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:44:46.459579 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:44:46.459664 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:46.459711 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:46.459762 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0127 16:44:46.459962 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:46.460003 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0127 16:44:46.460225 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:46.460217 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:46.460301 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I0127 16:44:46.460414 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0127 16:44:46.460089 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0127 16:44:46.460461 59286 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] } I0127 16:44:46.460538 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:46.460581 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:46.460624 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:46.460691 59286 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I0127 16:44:46.460802 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.460898 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:46.461002 59286 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0127 16:44:46.461129 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.461220 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.461440 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.461639 59286 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.461720 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.461981 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.462218 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.462358 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.462480 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.462604 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.462612 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:46.462684 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.462711 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:46.462776 59286 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.462821 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.462924 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:46.462922 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.463063 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0127 16:44:46.463159 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:46.463144 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] }] } I0127 16:44:46.463346 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:46.463456 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:46.463485 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0127 16:44:46.463556 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:46.463701 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.463893 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0127 16:44:46.463877 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I0127 16:44:46.464068 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.464232 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0127 16:44:46.464374 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.464554 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0127 16:44:46.464607 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.464740 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.464877 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.465025 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I0127 16:44:46.465167 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.465297 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:46.465338 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.465473 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:44:46.465560 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" }] }] } I0127 16:44:46.465683 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0127 16:44:46.465776 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.465914 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:46.465962 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0127 16:44:46.466133 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0127 16:44:46.466187 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0127 16:44:46.466231 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:46.466273 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:46.466313 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:46.466355 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:46.466443 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0127 16:44:46.466558 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0127 16:44:46.466616 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:46.466667 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:46.466730 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0127 16:44:46.466815 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0127 16:44:46.466899 59286 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0127 16:44:46.467009 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.467081 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:46.467164 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:46.467139 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.467254 59286 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:46.467356 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0127 16:44:46.467389 59286 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.467448 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I0127 16:44:46.467334 59286 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-3" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0127 16:44:46.467526 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0127 16:44:46.467585 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:46.467630 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.467782 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0127 16:44:46.467840 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-5" } I0127 16:44:46.467879 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:46.467920 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:46.467969 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0127 16:44:46.468008 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:46.468050 59286 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W0127 16:44:46.468123 59286 api.go:53] PageSize not implemented I0127 16:44:46.468206 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.468393 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0127 16:44:46.468444 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0127 16:44:46.468486 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:46.468558 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.468628 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.468686 59286 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0127 16:44:46.468733 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0127 16:44:46.468772 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0127 16:44:46.468812 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0127 16:44:46.468851 59286 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:46.468992 59286 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0127 16:44:46.469064 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0127 16:44:46.469151 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:44:46.469201 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:44:46.469247 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0127 16:44:46.469297 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:46.469338 59286 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0127 16:44:46.469426 59286 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0127 16:44:46.469522 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.469523 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:46.469549 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:46.469615 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:46.469637 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:46.469675 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I0127 16:44:46.469666 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:46.469734 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.469747 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:44:46.469774 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0127 16:44:46.469834 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:46.469881 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:46.469917 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:46.469880 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:46.470039 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0127 16:44:46.470100 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:46.470269 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I0127 16:44:46.470332 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0127 16:44:46.475629 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:44:46.475843 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:46.475964 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:46.476051 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:46.476173 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:46.476841 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:44:46.477114 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:44:46.477370 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:44:46.477415 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:46.477449 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:46.477520 59286 dns.go:235] Pre-creating DNS records I0127 16:44:46.477547 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:46.484380 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0127 16:44:46.488569 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:46.488665 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:47.777326 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:47.970248 59286 iamrole.go:89] ListRoles: { } I0127 16:44:47.972389 59286 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0127 16:44:47.972910 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:47.972958 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:47.973042 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.973245 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.974236 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.974869 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.975018 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:47.975051 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:47.975103 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:47.976695 59286 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0127 16:44:47.976860 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0127 16:44:47.976846 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0127 16:44:47.977020 59286 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0127 16:44:47.977021 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0127 16:44:47.977128 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0127 16:44:47.977222 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:47.977231 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0127 16:44:47.977279 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0127 16:44:47.977276 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:47.977368 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.977528 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0127 16:44:47.977687 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:47.977740 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:47.977856 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.977989 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:47.978079 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.978205 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.978377 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.978566 59286 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0127 16:44:47.978688 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.978803 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.978885 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.979048 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.979246 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0127 16:44:47.979296 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:44:47.979341 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0127 16:44:47.979381 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0127 16:44:47.979450 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0127 16:44:47.979604 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:47.979701 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.979780 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.979945 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:47.980011 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.980106 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.980254 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:47.980334 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.980532 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.980695 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0127 16:44:47.980748 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0127 16:44:47.980788 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0127 16:44:47.980854 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:47.980898 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0127 16:44:47.980935 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:47.981002 59286 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0127 16:44:47.981082 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:47.981194 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.981234 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:44:47.981309 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } W0127 16:44:47.981329 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:47.981349 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.981393 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.981428 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0127 16:44:47.981395 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.981466 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0127 16:44:47.981500 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0127 16:44:47.981527 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0127 16:44:47.981592 59286 api.go:53] PageSize not implemented I0127 16:44:47.981618 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.981703 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.981779 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.981859 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.981926 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:44:47.982015 59286 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0127 16:44:47.982090 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.982097 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:47.982167 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:47.982198 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.982189 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.982205 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:47.982286 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:47.982361 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:47.982421 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:47.982374 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:47.982423 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0127 16:44:47.982467 59286 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0127 16:44:47.982438 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.982342 59286 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0127 16:44:47.982501 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:47.982536 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:47.982587 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.982666 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.988198 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:44:47.988345 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:47.988517 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:47.988623 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:47.988798 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:47.989242 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:44:47.989467 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:44:47.989736 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:44:47.993079 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:44:47.993146 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:47.993214 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:44:47.993257 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0127 16:44:47.993301 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0127 16:44:47.993338 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:44:47.993375 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0127 16:44:47.993413 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:44:47.993448 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:44:47.993482 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:47.993519 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:44:47.993555 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:44:47.993600 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:44:47.993641 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0127 16:44:47.993679 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0127 16:44:47.993715 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:44:47.993750 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:44:47.993786 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:47.993824 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:44:47.993860 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:47.993897 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0127 16:44:47.993936 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:47.993973 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:47.994014 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:47.994052 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:47.994092 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:44:47.994127 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:47.994165 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:47.994203 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0127 16:44:47.994240 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0127 16:44:47.994278 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0127 16:44:47.994316 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:44:47.994351 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:44:47.994385 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:47.994424 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:47.994462 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:47.994504 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:44:47.996558 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:44:47.996628 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:44:47.996651 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:44:47.996696 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.996754 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0127 16:44:47.996819 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.996879 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.996929 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.996981 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.997030 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.997082 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0127 16:44:47.997150 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.997229 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:47.997262 59286 natgateway.go:117] DescribeNatGateways: { } I0127 16:44:47.997306 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0127 16:44:47.997349 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0127 16:44:47.997405 59286 api.go:53] PageSize not implemented I0127 16:44:47.997425 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:47.997451 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:47.997466 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0127 16:44:47.997505 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:44:47.997528 59286 targetgroups.go:35] PageSize not implemented I0127 16:44:47.997547 59286 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I0127 16:44:47.997611 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:44:47.997651 59286 iamrole.go:89] ListRoles: { } I0127 16:44:47.997695 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:47.997722 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:47.997763 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:44:47.997809 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:47.997863 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0127 16:44:47.997909 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:44:47.997945 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0127 16:44:47.997979 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0127 16:44:47.998012 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-config:lt-2 ok I0127 16:44:47.998712 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-group:nodes.minimal-ipv6.example.com ok I0127 16:44:47.998810 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0127 16:44:47.998719 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0127 16:44:47.998850 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:47.998854 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0127 16:44:47.998937 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I0127 16:44:47.998906 59286 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0127 16:44:47.998977 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0127 16:44:47.999025 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0127 16:44:47.998921 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.minimal-ipv6.example.com ok I0127 16:44:47.998907 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0127 16:44:47.999207 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:47.999231 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I0127 16:44:47.999291 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0127 16:44:47.999350 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:44:47.999400 59286 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0127 16:44:47.999462 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0127 16:44:47.999503 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:47.999555 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0127 16:44:47.999688 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:47.999708 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0127 16:44:47.999750 59286 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0127 16:44:47.999812 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0127 16:44:47.999915 59286 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0127 16:44:48.000008 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:44:48.000075 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:44:48.000131 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:48.000183 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0127 16:44:48.000285 59286 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0127 16:44:48.000345 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0127 16:44:48.000339 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0127 16:44:48.000420 59286 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0127 16:44:48.000401 59286 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } I0127 16:44:48.000442 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } elastic-ip:eipalloc-2 ok I0127 16:44:48.000478 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0127 16:44:48.000488 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0127 16:44:48.000514 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0127 16:44:48.000566 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0127 16:44:48.000548 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:44:48.000581 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0127 16:44:48.000611 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0127 16:44:48.000604 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0127 16:44:48.000704 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0127 16:44:48.000761 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0127 16:44:48.000838 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:44:48.000917 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (3.09s) === RUN TestLifecycleSharedVPC I0127 16:44:48.001780 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:48.002350 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:48.002404 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:48.002486 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:48.002528 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:48.002592 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:48.002908 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:48.003007 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:48.003089 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:48.003139 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0127 16:44:48.031773 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:48.034962 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:48.035059 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:49.345365 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:49.521630 59286 iamrole.go:89] ListRoles: { } I0127 16:44:49.523277 59286 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0127 16:44:49.524058 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:49.524312 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:49.524554 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:49.524714 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:49.524757 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:49.524773 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.524988 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0127 16:44:49.525148 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" }] } I0127 16:44:49.525444 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0127 16:44:49.525553 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0127 16:44:49.526312 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:44:49.526447 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:44:49.526490 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:44:49.526597 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] }] } I0127 16:44:49.526891 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:49.527133 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:49.528689 59286 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0127 16:44:49.528829 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:49.528909 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0127 16:44:49.529027 59286 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0127 16:44:49.529003 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:49.529094 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0127 16:44:49.529117 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:44:49.529116 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0127 16:44:49.529188 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:44:49.529245 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0127 16:44:49.529337 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0127 16:44:49.529373 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0127 16:44:49.529514 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0127 16:44:49.529558 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0127 16:44:49.529795 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0127 16:44:49.529917 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:49.529975 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:49.530054 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:49.530142 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:49.530186 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:49.530240 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] } I0127 16:44:49.530340 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:44:49.530506 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:49.530584 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:49.531556 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0127 16:44:49.534521 59286 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0127 16:44:49.534649 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:49.534875 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:44:49.534952 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:44:49.535041 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:49.535143 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.535413 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0127 16:44:49.535630 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0127 16:44:49.535782 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.535987 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.536127 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:49.536233 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.536373 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.536538 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0127 16:44:49.536680 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:49.536756 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.536904 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0127 16:44:49.536953 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:49.537055 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:49.537192 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:49.537449 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.537654 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.537805 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0127 16:44:49.537946 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0127 16:44:49.538095 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0127 16:44:49.538227 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0127 16:44:49.538408 59286 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0127 16:44:49.538708 59286 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0127 16:44:49.539055 59286 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0127 16:44:49.539119 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:49.539160 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:49.539228 59286 dns.go:235] Pre-creating DNS records I0127 16:44:49.539258 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:49.544963 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:44:49.548123 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:49.548211 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:50.928263 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:51.103464 59286 iamrole.go:89] ListRoles: { } I0127 16:44:51.104604 59286 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0127 16:44:51.104766 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.104960 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:44:51.105079 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:44:51.105120 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:44:51.105184 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:44:51.105409 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.105771 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:51.109698 59286 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0127 16:44:51.109920 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0127 16:44:51.109931 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:44:51.111029 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0127 16:44:51.111754 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:51.111840 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.111926 59286 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0127 16:44:51.111988 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:51.112032 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0127 16:44:51.112201 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:51.112244 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.118146 59286 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0127 16:44:51.118358 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:51.118647 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:51.118790 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:51.118957 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:51.119051 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:51.119238 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:51.119340 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:51.119737 59286 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0127 16:44:51.119993 59286 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0127 16:44:51.120295 59286 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0127 16:44:51.122894 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:44:51.122956 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:44:51.122998 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:44:51.123031 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:44:51.123064 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:44:51.123096 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:44:51.123133 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:44:51.123208 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:44:51.123252 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:44:51.123283 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:44:51.123313 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:51.123349 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:44:51.123378 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:51.123413 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:51.123446 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:51.123480 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:44:51.123511 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:44:51.123545 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:44:51.123574 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:51.123609 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:51.123645 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:44:51.125270 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:44:51.125335 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:44:51.125357 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:44:51.125396 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125444 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0127 16:44:51.125496 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125554 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125592 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125632 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125673 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125711 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0127 16:44:51.125755 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125808 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0127 16:44:51.125842 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0127 16:44:51.125891 59286 api.go:53] PageSize not implemented I0127 16:44:51.125911 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:51.125938 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:51.125957 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:44:51.125981 59286 targetgroups.go:35] PageSize not implemented I0127 16:44:51.125999 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:44:51.126052 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:44:51.126087 59286 iamrole.go:89] ListRoles: { } I0127 16:44:51.126133 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:51.126162 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:51.126202 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:44:51.126241 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:44:51.126294 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-2 ok I0127 16:44:51.126776 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok autoscaling-group:nodes.sharedvpc.example.com ok I0127 16:44:51.126712 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedvpc.example.com. ok I0127 16:44:51.126845 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0127 16:44:51.126876 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0127 16:44:51.127017 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:51.126968 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0127 16:44:51.127037 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } iam-instance-profile:nodes.sharedvpc.example.com ok security-group:sg-2 ok I0127 16:44:51.127076 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0127 16:44:51.127091 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0127 16:44:51.127162 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok volume:vol-1 ok I0127 16:44:51.127201 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:51.127294 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0127 16:44:51.127560 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:44:51.127599 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0127 16:44:51.127660 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:44:51.127747 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:44:51.127857 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:44:51.127860 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0127 16:44:51.127961 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0127 16:44:51.127985 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0127 16:44:51.128080 59286 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0127 16:44:51.128102 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0127 16:44:51.128149 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0127 16:44:51.128203 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0127 16:44:51.128239 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0127 16:44:51.128310 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (3.13s) === RUN TestLifecycleComplex I0127 16:44:51.128817 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:44:51.128989 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:44:51.129034 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:44:51.129084 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:44:51.129134 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:44:51.129192 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:44:51.129255 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:44:51.129297 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:44:51.129343 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:44:51.129382 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0127 16:44:51.164996 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:44:51.169278 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:51.169371 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:52.632325 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:52.835863 59286 iamrole.go:89] ListRoles: { } I0127 16:44:52.837807 59286 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0127 16:44:52.838062 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.838188 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:44:52.838339 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" } ] }], Throughput: 125, VolumeType: "gp3" } W0127 16:44:52.838479 59286 api.go:53] PageSize not implemented I0127 16:44:52.838525 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:44:52.838606 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.838647 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0127 16:44:52.838735 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0127 16:44:52.838754 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/main", Value: "a/a" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:44:52.838880 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:44:52.838935 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:44:52.839338 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:52.839405 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:44:52.839497 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.839730 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0127 16:44:52.839762 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:44:52.839804 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" } ] } I0127 16:44:52.839756 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0127 16:44:52.839922 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:44:52.839979 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:44:52.840020 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:44:52.840084 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:52.840131 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0127 16:44:52.840287 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:44:52.840347 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:44:52.842284 59286 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0127 16:44:52.842456 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:44:52.842524 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:52.842541 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:44:52.842628 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:44:52.842706 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:44:52.842683 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0127 16:44:52.842789 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:44:52.842758 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:52.842845 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:44:52.842948 59286 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0127 16:44:52.842963 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0127 16:44:52.843005 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.843052 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:44:52.843026 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0127 16:44:52.843194 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0127 16:44:52.843170 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.843215 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:52.843309 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0127 16:44:52.843383 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:44:52.843457 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:52.843438 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:52.843495 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:44:52.843714 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:52.843856 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.843964 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:52.844046 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:52.844120 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:44:52.844154 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:44:52.844238 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:44:52.844320 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.844402 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:52.844535 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:44:52.844603 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:44:52.844673 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:52.844712 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:52.844759 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:44:52.844902 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:44:52.844878 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0127 16:44:52.844976 59286 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0127 16:44:52.845039 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0127 16:44:52.845155 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:44:52.844844 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0127 16:44:52.845212 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0127 16:44:52.845321 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:44:52.845373 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:52.845417 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0127 16:44:52.845619 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:44:52.845583 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0127 16:44:52.845725 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:52.845784 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:44:52.845837 59286 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" } ] } I0127 16:44:52.845940 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:44:52.846003 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I0127 16:44:52.846136 59286 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0127 16:44:52.846270 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:52.846377 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:52.846526 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I0127 16:44:52.847315 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:52.847618 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0127 16:44:52.847787 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0127 16:44:52.848062 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0127 16:44:52.848374 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0127 16:44:52.848517 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0127 16:44:52.848717 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:52.848837 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0127 16:44:52.849070 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0127 16:44:52.849239 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I0127 16:44:52.849365 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0127 16:44:52.849689 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0127 16:44:52.849962 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0127 16:44:52.850356 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" } ] }] } I0127 16:44:52.850755 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:52.850852 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:52.850934 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:52.851479 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:44:52.851580 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0127 16:44:52.851768 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0127 16:44:52.851903 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0127 16:44:52.852647 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I0127 16:44:52.852868 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0127 16:44:52.853004 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0127 16:44:52.853216 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0127 16:44:52.853406 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0127 16:44:52.853583 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0127 16:44:52.853723 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0127 16:44:52.853903 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0127 16:44:52.854097 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0127 16:44:52.854275 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:52.854346 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:44:52.854411 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0127 16:44:52.854598 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0127 16:44:52.854660 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:44:52.854725 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0127 16:44:52.854851 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0127 16:44:52.854993 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0127 16:44:52.855178 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0127 16:44:52.855300 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0127 16:44:52.855368 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:44:52.855425 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:52.855497 59286 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0127 16:44:52.855595 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:52.855666 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:52.855612 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:52.855784 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0127 16:44:52.855840 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0127 16:44:52.855783 59286 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0127 16:44:52.855898 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:52.855954 59286 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0127 16:44:52.856046 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0127 16:44:52.856115 59286 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:44:52.856189 59286 api.go:53] PageSize not implemented I0127 16:44:52.856237 59286 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0127 16:44:52.856311 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:52.856393 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:52.856320 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:52.856427 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:52.856501 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:52.856653 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:52.856640 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:52.856836 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:52.856807 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:52.856864 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:52.862657 59286 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0127 16:44:52.862859 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:52.862991 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:52.863159 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:52.863300 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:52.864147 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:44:52.864566 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:44:52.864925 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0127 16:44:52.864985 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:52.865021 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:52.865091 59286 dns.go:235] Pre-creating DNS records I0127 16:44:52.865117 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:52.873611 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:44:52.877797 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:52.877891 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:54.229755 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:54.428455 59286 iamrole.go:89] ListRoles: { } I0127 16:44:54.430627 59286 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0127 16:44:54.431492 59286 api.go:53] PageSize not implemented I0127 16:44:54.431594 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:44:54.431854 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:44:54.431994 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:44:54.432544 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.432696 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:54.432733 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:54.432820 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.432994 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:54.433015 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.433159 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.433364 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:54.433424 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:44:54.435293 59286 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0127 16:44:54.435473 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:44:54.435423 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:44:54.435555 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:44:54.435556 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:54.435433 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.435624 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:44:54.435700 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:44:54.435672 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.435797 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:54.435837 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:44:54.435910 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:54.436041 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:44:54.436243 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:54.436343 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:54.436470 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.436673 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.436851 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:54.436911 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:44:54.437137 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:54.437209 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:54.437362 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:44:54.437543 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:54.437616 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:54.437787 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.437970 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:54.438195 59286 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0127 16:44:54.438350 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:54.438503 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.438728 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:54.438778 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:54.438917 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:54.439049 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:54.439414 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:54.439616 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:54.439935 59286 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0127 16:44:54.440026 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:54.440092 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:54.440058 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:54.440109 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:54.440153 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:54.440193 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:44:54.440232 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:54.440268 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:54.440299 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:44:54.440392 59286 api.go:53] PageSize not implemented I0127 16:44:54.440437 59286 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0127 16:44:54.440482 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:54.440529 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:54.440526 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:54.440544 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:54.440613 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:54.440641 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:54.440668 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:54.440639 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:54.440745 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:54.440714 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:54.440796 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:54.440824 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:54.440931 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:54.440970 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:54.446334 59286 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0127 16:44:54.446549 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:54.446743 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:54.446830 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:54.447010 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:54.447573 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:44:54.447911 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:44:54.448156 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0127 16:44:54.454226 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:54.457745 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:54.469969 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:44:54.474054 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:54.474145 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:55.986708 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:56.188120 59286 iamrole.go:89] ListRoles: { } I0127 16:44:56.190421 59286 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0127 16:44:56.190839 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:44:56.191220 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:44:56.191354 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:44:56.191545 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:44:56.191741 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.191866 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:56.191930 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.192040 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:56.192074 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:56.192112 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.192376 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0127 16:44:56.192723 59286 api.go:53] PageSize not implemented I0127 16:44:56.193196 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.194822 59286 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0127 16:44:56.194967 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.195096 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:44:56.195199 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:44:56.195105 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:44:56.195219 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:56.195291 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:44:56.195311 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:44:56.195315 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:56.195388 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:44:56.195498 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:56.195551 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:44:56.195498 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.195670 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:56.195717 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:56.195768 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.195909 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:56.195948 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:56.196035 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:44:56.196186 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:56.196232 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:56.196321 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.196458 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.196605 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:56.196692 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:44:56.196831 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:56.196948 59286 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0127 16:44:56.197132 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:56.197295 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:56.197506 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:56.197665 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:56.197744 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:56.197867 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:56.198072 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:56.198252 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:56.198650 59286 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0127 16:44:56.198739 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:56.198803 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:56.198745 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:56.198820 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.198865 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.198902 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:44:56.198942 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:56.198976 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:56.199009 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:44:56.199180 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0127 16:44:56.199218 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:44:56.199251 59286 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0127 16:44:56.199283 59286 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0127 16:44:56.199317 59286 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0127 16:44:56.199410 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0127 16:44:56.199481 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.199515 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0127 16:44:56.199559 59286 api.go:53] PageSize not implemented I0127 16:44:56.199606 59286 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0127 16:44:56.199677 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:56.199747 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:56.199685 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:56.199765 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:44:56.199796 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0127 16:44:56.199812 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:56.199831 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:56.199875 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.199882 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:56.199993 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:56.199960 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.200231 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.200433 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:56.200467 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:56.206084 59286 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0127 16:44:56.206233 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:56.206414 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:56.206574 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:56.206752 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:56.207268 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:44:56.207510 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:44:56.207787 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0127 16:44:56.207841 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:56.207879 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:56.207951 59286 dns.go:235] Pre-creating DNS records I0127 16:44:56.215979 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:44:56.220211 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:56.220308 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:57.578823 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:57.779524 59286 iamrole.go:89] ListRoles: { } I0127 16:44:57.781525 59286 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0127 16:44:57.781865 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:57.781868 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.782039 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W0127 16:44:57.782188 59286 api.go:53] PageSize not implemented I0127 16:44:57.782181 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.782304 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:44:57.782448 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:57.782480 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:57.782534 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:57.782572 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.782713 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:44:57.782816 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:44:57.782905 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:44:57.784517 59286 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0127 16:44:57.784659 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:44:57.784770 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:57.784817 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:44:57.784869 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:44:57.784917 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:44:57.784905 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:44:57.784968 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:57.784999 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:44:57.784702 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.785111 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:57.785250 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.785468 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:57.785562 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.785717 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.785864 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:57.785904 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:44:57.786070 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:57.786134 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:57.786249 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:44:57.786446 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:57.786605 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:57.786734 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.786876 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:44:57.787065 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:57.787128 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:57.787236 59286 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0127 16:44:57.787432 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:57.787613 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:57.787776 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:57.787977 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:57.788071 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:57.788153 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.788297 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:57.788799 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:57.789030 59286 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0127 16:44:57.789130 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:57.789200 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:57.789152 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:57.789220 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:57.789268 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:57.789303 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:44:57.789346 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:57.789382 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:57.789415 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:44:57.789501 59286 api.go:53] PageSize not implemented I0127 16:44:57.789548 59286 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0127 16:44:57.789606 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:57.789664 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:57.789620 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:57.789695 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:57.789684 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:57.789753 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:57.789727 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:57.789800 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:57.789778 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:57.789868 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:57.790100 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:57.790166 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:57.790217 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:57.790242 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:57.799868 59286 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0127 16:44:57.800012 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:57.800184 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:57.800334 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:57.800536 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:57.801454 59286 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0127 16:44:57.801930 59286 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0127 16:44:57.802385 59286 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0127 16:44:57.806354 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:57.810063 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:57.822268 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:44:57.826398 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:57.826488 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.148342 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:59.342588 59286 iamrole.go:89] ListRoles: { } I0127 16:44:59.344070 59286 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0127 16:44:59.344249 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:44:59.344556 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0127 16:44:59.344764 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W0127 16:44:59.344826 59286 api.go:53] PageSize not implemented I0127 16:44:59.344841 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:44:59.344997 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.345190 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:44:59.345256 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:44:59.345362 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:59.345438 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:44:59.345691 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.347190 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:44:59.347700 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:44:59.347954 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.352743 59286 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0127 16:44:59.352909 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:59.353077 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:44:59.353074 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.353237 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:59.353305 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:44:59.353323 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:59.353318 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:44:59.353432 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:59.353471 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:44:59.353407 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:44:59.353520 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:44:59.353570 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:59.353626 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:44:59.353598 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.353717 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:44:59.353903 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:44:59.353951 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:44:59.354013 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.354158 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:44:59.354219 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:44:59.354484 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:44:59.354572 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.354745 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.354930 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:44:59.355129 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:44:59.355349 59286 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0127 16:44:59.355660 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:59.355828 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:59.356097 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:59.356212 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:44:59.356391 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:44:59.356546 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:44:59.356802 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:59.356948 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:44:59.357243 59286 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0127 16:44:59.357345 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:44:59.357361 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0127 16:44:59.357429 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:59.357498 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:59.357544 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:59.357579 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:44:59.357616 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:44:59.357651 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:44:59.357683 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:44:59.357778 59286 api.go:53] PageSize not implemented I0127 16:44:59.357829 59286 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0127 16:44:59.357877 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:59.357925 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:59.357942 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:59.357937 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:59.358042 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:59.358023 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:44:59.358099 59286 loadbalancers.go:35] PageSize not implemented I0127 16:44:59.358072 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:44:59.358153 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:44:59.358130 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:59.358322 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:59.358360 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:59.358425 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:44:59.358450 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:44:59.364139 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:44:59.364318 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.364563 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.364648 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.364802 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.365566 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.365633 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.365784 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:44:59.366015 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:44:59.366357 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:44:59.366400 59286 zones.go:93] ListHostedZonesPages { } I0127 16:44:59.366433 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:44:59.366496 59286 dns.go:235] Pre-creating DNS records I0127 16:44:59.374430 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:44:59.378630 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:44:59.378723 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.713596 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:00.917446 59286 iamrole.go:89] ListRoles: { } I0127 16:45:00.919528 59286 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0127 16:45:00.919745 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.919940 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:45:00.920058 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.920174 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:45:00.920426 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.920649 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:00.920716 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:45:00.920823 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0127 16:45:00.920847 59286 api.go:53] PageSize not implemented I0127 16:45:00.920939 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:00.920905 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.921177 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0127 16:45:00.921316 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:45:00.921410 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:45:00.922495 59286 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0127 16:45:00.922700 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:45:00.922778 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:00.922811 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:45:00.922879 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:45:00.922672 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.922933 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:00.922955 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:45:00.922959 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:45:00.923019 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:45:00.922970 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0127 16:45:00.923120 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:45:00.923383 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:00.923453 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.923602 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:00.923657 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:45:00.923809 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:00.923869 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.924073 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:00.924181 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:45:00.924370 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:00.924415 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0127 16:45:00.924531 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:00.924604 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:00.924672 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:00.924848 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:00.924929 59286 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0127 16:45:00.925051 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:00.925155 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:00.925334 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:00.925497 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:45:00.925719 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:00.926017 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:00.926191 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:00.926410 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:00.926630 59286 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0127 16:45:00.926707 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:00.926777 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:00.926865 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:00.926885 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:00.926926 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:00.926962 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:45:00.927000 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:00.927033 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:00.927063 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:45:00.927162 59286 api.go:53] PageSize not implemented I0127 16:45:00.927226 59286 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0127 16:45:00.927281 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:00.927358 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:00.927316 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:00.927397 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:00.927393 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:00.927406 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:00.927526 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:00.927565 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:00.927606 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:00.927695 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:00.927751 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:00.927841 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:00.927933 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:00.927957 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:00.935297 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:45:00.935678 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.936014 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.936228 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.936447 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.937860 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:45:00.938790 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:45:00.939126 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0127 16:45:00.943782 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:00.947423 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.947581 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.957407 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:45:00.961495 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.961584 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:00.961639 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.290210 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:02.480957 59286 iamrole.go:89] ListRoles: { } I0127 16:45:02.483209 59286 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0127 16:45:02.483606 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:02.483771 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:45:02.483598 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:02.483881 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:45:02.484224 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:45:02.484379 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0127 16:45:02.484463 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0127 16:45:02.484628 59286 api.go:53] PageSize not implemented I0127 16:45:02.484603 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:02.484807 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:02.484901 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:02.484926 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:45:02.484985 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:45:02.485553 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:02.486822 59286 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0127 16:45:02.486975 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:02.487156 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:02.487206 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:45:02.487313 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:45:02.487298 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:45:02.487367 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:02.487393 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:02.487437 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:45:02.487487 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:45:02.487428 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:02.487514 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:45:02.487605 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:02.487647 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:45:02.487575 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:45:02.487768 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:02.487865 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:45:02.488001 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:45:02.488166 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:02.488226 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:02.488310 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:45:02.488466 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:02.488504 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0127 16:45:02.488605 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:02.488709 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:02.488817 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:02.488943 59286 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0127 16:45:02.489082 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:02.489155 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:02.489257 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:02.489400 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:45:02.489473 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:02.489601 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:02.490215 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:02.490425 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:02.490609 59286 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0127 16:45:02.490682 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:02.490759 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:02.490849 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:02.490869 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:02.490923 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:02.490961 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:45:02.491000 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:02.491033 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:02.491067 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:45:02.491160 59286 api.go:53] PageSize not implemented I0127 16:45:02.491210 59286 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0127 16:45:02.491284 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:02.491367 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:02.491287 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:02.491403 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:02.491380 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:02.491420 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:02.491484 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:02.491494 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:02.491551 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:02.491578 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:02.491672 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:02.491728 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:02.491807 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:02.491835 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:02.497280 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:45:02.497430 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.497600 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.497713 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.497889 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.498654 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:45:02.498979 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:45:02.499251 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:45:02.499305 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:02.499344 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:02.499411 59286 dns.go:235] Pre-creating DNS records I0127 16:45:02.507409 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:45:02.511568 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.511665 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:02.511721 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:03.845049 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:04.037470 59286 iamrole.go:89] ListRoles: { } I0127 16:45:04.039710 59286 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0127 16:45:04.040010 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0127 16:45:04.040202 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.040231 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0127 16:45:04.040399 59286 api.go:53] PageSize not implemented I0127 16:45:04.040356 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.040504 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:45:04.040743 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:45:04.041039 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:45:04.041393 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:45:04.041605 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:04.041660 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:45:04.041757 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:04.041914 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:45:04.042135 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.043346 59286 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0127 16:45:04.043469 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:45:04.043526 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:45:04.043613 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:04.043647 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:45:04.043674 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:45:04.043639 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.043759 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:45:04.043779 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:45:04.043767 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.043865 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:04.043920 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:45:04.043924 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:04.044059 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:45:04.044239 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:04.044303 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.044494 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:04.044619 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.044799 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:04.044867 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:45:04.045022 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:04.045139 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.045261 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:04.045372 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:04.045472 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:04.045579 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:04.045684 59286 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0127 16:45:04.045867 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:04.045971 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:04.046385 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:04.046500 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:04.046632 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:04.046744 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:04.046833 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:04.046982 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:45:04.047305 59286 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0127 16:45:04.047392 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:04.047420 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:04.047486 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:04.047509 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:04.047555 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:04.047590 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:45:04.047629 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:04.047665 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:04.047697 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:45:04.047785 59286 api.go:53] PageSize not implemented I0127 16:45:04.047846 59286 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0127 16:45:04.047915 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:45:04.047921 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0127 16:45:04.047978 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:04.047997 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:04.047998 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:04.048058 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:04.048034 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:04.048083 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:04.048136 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:04.048168 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:04.048401 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:04.048457 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:04.048535 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:04.048561 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:04.053932 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:45:04.054049 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.054216 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.054386 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.054540 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.055033 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:45:04.055265 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:45:04.055529 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0127 16:45:04.058507 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:04.061989 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.062078 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.062136 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.071941 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:45:04.076093 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.076187 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.076242 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:04.076295 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.428247 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:05.617252 59286 iamrole.go:89] ListRoles: { } I0127 16:45:05.621294 59286 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0127 16:45:05.621544 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0127 16:45:05.621759 59286 api.go:53] PageSize not implemented I0127 16:45:05.621802 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:45:05.621936 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:45:05.622043 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:45:05.622156 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0127 16:45:05.622260 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:45:05.622388 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:05.622685 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:05.622739 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:05.622882 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0127 16:45:05.623034 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:05.623074 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:45:05.623131 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:05.625568 59286 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0127 16:45:05.625785 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:45:05.625730 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:45:05.625881 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:05.625952 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:05.626015 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:45:05.626038 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:45:05.626084 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:45:05.626057 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:05.626138 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:45:05.626234 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:05.626272 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:45:05.626247 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:05.626347 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:05.626433 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:05.626554 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:45:05.626764 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:05.626821 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:45:05.626971 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:05.627022 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:05.627171 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:05.627323 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:05.627365 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:05.627501 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0127 16:45:05.627665 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0127 16:45:05.627801 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:05.627883 59286 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0127 16:45:05.627980 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:05.628107 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:05.628216 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:05.628390 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:05.628841 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:05.628974 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:05.629122 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:45:05.629259 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:05.629650 59286 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0127 16:45:05.629734 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:05.629755 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:05.629829 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:05.629869 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:05.629920 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:05.629956 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:45:05.629993 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:05.630029 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:05.630061 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:45:05.630151 59286 api.go:53] PageSize not implemented I0127 16:45:05.630212 59286 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0127 16:45:05.630260 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:05.630307 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:05.630304 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:05.630322 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:05.630386 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:05.630419 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:05.630398 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:05.630461 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:05.630497 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:05.630522 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:05.630559 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:05.630624 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:05.630679 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:05.630697 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:05.636444 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:45:05.636645 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.636816 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.636934 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.637120 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.637974 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:45:05.638298 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:45:05.638502 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:45:05.638548 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:05.638584 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:05.638649 59286 dns.go:235] Pre-creating DNS records I0127 16:45:05.646841 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0127 16:45:05.651147 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.651245 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.651304 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:05.651355 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:06.972845 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:07.154335 59286 iamrole.go:89] ListRoles: { } I0127 16:45:07.155702 59286 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0127 16:45:07.155866 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.156772 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0127 16:45:07.157482 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0127 16:45:07.157727 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.159586 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0127 16:45:07.160422 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.161142 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0127 16:45:07.161740 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:07.161963 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.162081 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:07.162120 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0127 16:45:07.162163 59286 api.go:53] PageSize not implemented I0127 16:45:07.162191 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:07.162657 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0127 16:45:07.163685 59286 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0127 16:45:07.163915 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.164138 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:45:07.164141 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:07.164247 59286 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0127 16:45:07.164200 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0127 16:45:07.164319 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:07.164275 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0127 16:45:07.164392 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0127 16:45:07.164489 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:07.164462 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0127 16:45:07.164554 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:07.164595 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0127 16:45:07.164542 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.164701 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.164836 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0127 16:45:07.164991 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:07.165053 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:07.165146 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:07.165227 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0127 16:45:07.165386 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:07.165428 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:07.165502 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:07.165539 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.165636 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.165844 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:07.166474 59286 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0127 16:45:07.166695 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.166874 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0127 16:45:07.166982 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:07.167144 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:07.167282 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:07.167394 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:07.167540 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:07.167826 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:07.168136 59286 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0127 16:45:07.168222 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:07.168285 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:07.168302 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.168265 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:07.168345 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.168444 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0127 16:45:07.168498 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0127 16:45:07.168534 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0127 16:45:07.168570 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0127 16:45:07.168667 59286 api.go:53] PageSize not implemented I0127 16:45:07.168733 59286 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0127 16:45:07.168805 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:07.168856 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:07.168818 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:07.168898 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:07.168872 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.168943 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:07.169017 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:07.169082 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:07.169104 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.169182 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:07.169061 59286 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0127 16:45:07.169228 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.169323 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0127 16:45:07.169364 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.175038 59286 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0127 16:45:07.175170 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:07.175342 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:07.175494 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:07.175684 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:07.176594 59286 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0127 16:45:07.176854 59286 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0127 16:45:07.177191 59286 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0127 16:45:07.177380 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:45:07.177441 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:45:07.177482 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:45:07.177516 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:07.177550 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:45:07.177583 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:45:07.177615 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:45:07.177651 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:45:07.177692 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:45:07.177736 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:45:07.177770 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:45:07.177803 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:07.177841 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:45:07.177873 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:45:07.177911 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:07.177948 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:07.177984 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:45:07.178021 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:07.178060 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:07.178103 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:45:07.178142 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0127 16:45:07.178179 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:07.178211 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:45:07.178243 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:07.178281 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:07.178318 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:45:07.178353 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:45:07.181127 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:45:07.181202 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:45:07.181224 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:45:07.181260 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181317 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0127 16:45:07.181384 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181442 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181491 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181544 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181585 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181634 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0127 16:45:07.181691 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181759 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0127 16:45:07.181800 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0127 16:45:07.181853 59286 api.go:53] PageSize not implemented I0127 16:45:07.181872 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:07.181896 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:07.181911 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0127 16:45:07.181953 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:45:07.181977 59286 targetgroups.go:35] PageSize not implemented I0127 16:45:07.181994 59286 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I0127 16:45:07.182068 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:45:07.182106 59286 iamrole.go:89] ListRoles: { } I0127 16:45:07.182148 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:07.182175 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:07.182235 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:45:07.182282 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:07.182327 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0127 16:45:07.182885 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0127 16:45:07.182950 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0127 16:45:07.182926 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0127 16:45:07.182948 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } autoscaling-group:nodes.complex.example.com ok I0127 16:45:07.183015 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I0127 16:45:07.183039 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok I0127 16:45:07.183058 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0127 16:45:07.183114 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } iam-instance-profile:masters.complex.example.com ok I0127 16:45:07.183219 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0127 16:45:07.183309 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I0127 16:45:07.183096 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.complex.example.com. ok internet-gateway:igw-2 ok I0127 16:45:07.183168 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } I0127 16:45:07.183312 59286 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok W0127 16:45:07.183419 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:07.183438 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0127 16:45:07.183481 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0127 16:45:07.183544 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:07.183615 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:45:07.183651 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:07.183703 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 } ] } W0127 16:45:07.184053 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:07.184074 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0127 16:45:07.184128 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:45:07.184187 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok autoscaling-config:lt-1 ok I0127 16:45:07.184281 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:45:07.184347 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0127 16:45:07.184341 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0127 16:45:07.184433 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0127 16:45:07.184453 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0127 16:45:07.184492 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0127 16:45:07.184528 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0127 16:45:07.184575 59286 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0127 16:45:07.184589 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0127 16:45:07.184617 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0127 16:45:07.184704 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:45:07.184786 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:45:07.184871 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (16.06s) === RUN TestLifecycleExternalLB I0127 16:45:07.185378 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:45:07.185523 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:45:07.185565 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:45:07.185607 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:45:07.185646 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:45:07.185694 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:45:07.185737 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:45:07.185769 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:45:07.185808 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:45:07.185837 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0127 16:45:07.211759 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:07.215047 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:07.215144 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:08.545355 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:08.733756 59286 iamrole.go:89] ListRoles: { } I0127 16:45:08.735105 59286 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0127 16:45:08.735753 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:08.735994 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:08.736052 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0127 16:45:08.736203 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0127 16:45:08.736264 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0127 16:45:08.736217 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.736011 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0127 16:45:08.736398 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0127 16:45:08.736661 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0127 16:45:08.736623 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:08.736746 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0127 16:45:08.736845 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.736984 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0127 16:45:08.737113 59286 api.go:53] PageSize not implemented I0127 16:45:08.737114 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0127 16:45:08.737218 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0127 16:45:08.737258 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0127 16:45:08.737344 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } W0127 16:45:08.737407 59286 api.go:53] PageSize not implemented I0127 16:45:08.737413 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:45:08.737207 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:08.738256 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:08.738339 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:45:08.738420 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:08.738554 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] }] } I0127 16:45:08.738862 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0127 16:45:08.738851 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:08.738889 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0127 16:45:08.739085 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:08.739182 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:45:08.739253 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:45:08.739297 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } W0127 16:45:08.739344 59286 api.go:53] PageSize not implemented I0127 16:45:08.739357 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:08.743041 59286 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0127 16:45:08.743306 59286 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0127 16:45:08.743357 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:08.743633 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0127 16:45:08.743660 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" } ] }], VpcId: "vpc-1" } I0127 16:45:08.743826 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:08.743809 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0127 16:45:08.743893 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0127 16:45:08.743891 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:08.744780 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0127 16:45:08.744120 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.745150 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:45:08.745214 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:08.745260 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:08.745452 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:08.745681 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:45:08.745743 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0127 16:45:08.745885 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0127 16:45:08.746000 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:08.746109 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:45:08.746153 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:45:08.746276 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:08.746345 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:08.746409 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" }] }], VpcId: "vpc-1" } I0127 16:45:08.746629 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:08.746694 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:08.746360 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0127 16:45:08.746744 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:45:08.746919 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I0127 16:45:08.747017 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:08.747064 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] } I0127 16:45:08.750538 59286 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0127 16:45:08.750774 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0127 16:45:08.750956 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.751177 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0127 16:45:08.751317 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" }] }] } I0127 16:45:08.751523 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.751736 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.751871 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:08.752017 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:45:08.752071 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:08.752153 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:08.752218 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:45:08.752257 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:08.752372 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.752661 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:08.752931 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0127 16:45:08.753319 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.753500 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.753645 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.753781 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:45:08.753844 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I0127 16:45:08.753985 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:08.754095 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:08.754159 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:45:08.754254 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0127 16:45:08.754422 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0127 16:45:08.755006 59286 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0127 16:45:08.755395 59286 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0127 16:45:08.755715 59286 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0127 16:45:08.755771 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:08.755810 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:08.755878 59286 dns.go:235] Pre-creating DNS records I0127 16:45:08.755909 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:08.762199 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:08.765434 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:08.765531 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:10.075003 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:10.261190 59286 iamrole.go:89] ListRoles: { } I0127 16:45:10.262891 59286 executor.go:111] Tasks: 0 done / 107 total; 51 can run W0127 16:45:10.263475 59286 api.go:53] PageSize not implemented I0127 16:45:10.263671 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.263928 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:45:10.263884 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.264036 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:45:10.264075 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0127 16:45:10.264082 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:10.264138 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:45:10.264216 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:10.264359 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:10.264411 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.264487 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0127 16:45:10.264627 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0127 16:45:10.264689 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } W0127 16:45:10.264736 59286 api.go:53] PageSize not implemented W0127 16:45:10.264789 59286 api.go:53] PageSize not implemented I0127 16:45:10.264748 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0127 16:45:10.264873 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0127 16:45:10.264912 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0127 16:45:10.264936 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.265638 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:10.266880 59286 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0127 16:45:10.267011 59286 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0127 16:45:10.267074 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:10.267170 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.267247 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0127 16:45:10.267294 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.267426 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:10.267466 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0127 16:45:10.267626 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:10.267689 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:10.267810 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0127 16:45:10.268001 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:10.268101 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.272853 59286 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0127 16:45:10.272994 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:10.273128 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:10.273237 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:10.273352 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:10.273806 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:10.274004 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:10.274276 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:10.274765 59286 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0127 16:45:10.275029 59286 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0127 16:45:10.275293 59286 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0127 16:45:10.278272 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:45:10.278338 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:45:10.278377 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:45:10.278410 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:10.278443 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:45:10.278477 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:45:10.278510 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:45:10.278545 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:45:10.278580 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:45:10.278623 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:45:10.278659 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:45:10.278689 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:45:10.278724 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:10.278757 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:45:10.278789 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:10.278821 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:10.278855 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:10.278888 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:10.278920 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:10.278952 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:45:10.278989 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:10.279028 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:10.279065 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:45:10.279099 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:45:10.280423 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:45:10.280491 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:45:10.280513 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:45:10.280559 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.280607 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0127 16:45:10.280660 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.280718 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.280767 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.280823 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.280865 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.280904 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0127 16:45:10.280951 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.281005 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0127 16:45:10.281046 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0127 16:45:10.281097 59286 api.go:53] PageSize not implemented I0127 16:45:10.281118 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:10.281144 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:10.281162 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:45:10.281185 59286 targetgroups.go:35] PageSize not implemented I0127 16:45:10.281201 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:45:10.281252 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:45:10.281295 59286 iamrole.go:89] ListRoles: { } I0127 16:45:10.281349 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:10.281380 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:10.281422 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:45:10.281467 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:10.281504 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:10.281985 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0127 16:45:10.282069 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0127 16:45:10.282048 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-group:nodes.externallb.example.com ok I0127 16:45:10.281950 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok volume:vol-1 ok I0127 16:45:10.282128 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:10.282139 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0127 16:45:10.282216 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0127 16:45:10.282186 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0127 16:45:10.282325 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:10.282351 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:45:10.282398 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0127 16:45:10.282462 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I0127 16:45:10.282508 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:10.282558 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0127 16:45:10.282760 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:10.282781 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0127 16:45:10.282825 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0127 16:45:10.282897 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:45:10.283003 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0127 16:45:10.283051 59286 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0127 16:45:10.283067 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0127 16:45:10.283036 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:45:10.283103 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0127 16:45:10.283194 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0127 16:45:10.283217 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0127 16:45:10.283263 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0127 16:45:10.283303 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0127 16:45:10.283379 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:45:10.283463 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:45:10.283540 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (3.10s) === RUN TestLifecycleSharedSubnet I0127 16:45:10.284000 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:45:10.284135 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:45:10.284173 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:45:10.284217 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:45:10.284255 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:45:10.284306 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:45:10.284346 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:45:10.284377 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:45:10.284415 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:45:10.284442 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0127 16:45:10.313681 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:10.316912 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:10.317007 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:11.644731 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:11.823036 59286 iamrole.go:89] ListRoles: { } I0127 16:45:11.823992 59286 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0127 16:45:11.826099 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:11.824708 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0127 16:45:11.826304 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0127 16:45:11.826732 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:11.827052 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:45:11.827889 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:45:11.828012 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:45:11.828074 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0127 16:45:11.828299 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:11.828650 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:11.828890 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0127 16:45:11.828962 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:11.828960 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" }] } I0127 16:45:11.829338 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:11.830060 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:11.830219 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:11.832328 59286 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0127 16:45:11.832544 59286 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0127 16:45:11.832583 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0127 16:45:11.832675 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0127 16:45:11.832789 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0127 16:45:11.832819 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:11.832931 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:11.832948 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0127 16:45:11.832998 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:11.833046 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0127 16:45:11.833221 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0127 16:45:11.833245 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0127 16:45:11.833513 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:45:11.833648 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:11.833743 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:11.833789 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:11.833831 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:11.833885 59286 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] } I0127 16:45:11.834952 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0127 16:45:11.838444 59286 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0127 16:45:11.838674 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0127 16:45:11.838938 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0127 16:45:11.839098 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0127 16:45:11.839251 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0127 16:45:11.839464 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" }] }] } I0127 16:45:11.839673 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0127 16:45:11.839912 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0127 16:45:11.840076 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0127 16:45:11.840306 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" }] }] } I0127 16:45:11.840535 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0127 16:45:11.840675 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:11.840781 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:11.840872 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0127 16:45:11.841054 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" }] }] } I0127 16:45:11.841206 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:11.841304 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:11.841395 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I0127 16:45:11.841617 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0127 16:45:11.841854 59286 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0127 16:45:11.842146 59286 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0127 16:45:11.842386 59286 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0127 16:45:11.842441 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:11.842482 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:11.842552 59286 dns.go:235] Pre-creating DNS records I0127 16:45:11.842583 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:11.848556 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:11.851807 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:11.851897 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.203094 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:13.387570 59286 iamrole.go:89] ListRoles: { } I0127 16:45:13.388919 59286 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0127 16:45:13.389238 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.389359 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:13.390032 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] }] } I0127 16:45:13.390248 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:13.390393 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:45:13.390469 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:45:13.390499 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:45:13.392704 59286 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0127 16:45:13.392876 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:45:13.393020 59286 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0127 16:45:13.393202 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0127 16:45:13.393054 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0127 16:45:13.393327 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:13.393419 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0127 16:45:13.393640 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0127 16:45:13.393932 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:13.398711 59286 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0127 16:45:13.398922 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.399137 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.399571 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.399726 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.400450 59286 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0127 16:45:13.400653 59286 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0127 16:45:13.400914 59286 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0127 16:45:13.403562 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:45:13.403626 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:45:13.403664 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:13.403696 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:45:13.403737 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:45:13.403771 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:45:13.403806 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:45:13.403843 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:45:13.403882 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:45:13.403914 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:45:13.403945 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:45:13.403977 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:13.404008 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:13.404042 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:13.404077 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:13.404108 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:45:13.404140 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:13.404175 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:13.404209 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:45:13.405537 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:45:13.405598 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:45:13.405621 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:45:13.405662 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.405709 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0127 16:45:13.405761 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.405815 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.405854 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.405893 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.405933 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.405967 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0127 16:45:13.406004 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.406049 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0127 16:45:13.406085 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0127 16:45:13.406131 59286 api.go:53] PageSize not implemented I0127 16:45:13.406154 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:13.406181 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:13.406200 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:45:13.406224 59286 targetgroups.go:35] PageSize not implemented I0127 16:45:13.406242 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:45:13.406292 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:45:13.406331 59286 iamrole.go:89] ListRoles: { } I0127 16:45:13.406375 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:13.406406 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:13.406450 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:45:13.406488 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:13.406872 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0127 16:45:13.406937 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0127 16:45:13.406927 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok autoscaling-group:nodes.sharedsubnet.example.com ok I0127 16:45:13.407038 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0127 16:45:13.407126 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok iam-instance-profile:nodes.sharedsubnet.example.com ok I0127 16:45:13.407016 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedsubnet.example.com. ok I0127 16:45:13.407028 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0127 16:45:13.407339 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:13.407370 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0127 16:45:13.407470 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:13.407550 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0127 16:45:13.407689 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:13.407719 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:45:13.407767 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:45:13.407874 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:45:13.407959 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0127 16:45:13.408047 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0127 16:45:13.408121 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0127 16:45:13.408143 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0127 16:45:13.408192 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0127 16:45:13.408267 59286 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0127 16:45:13.408284 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0127 16:45:13.408318 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0127 16:45:13.408354 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (3.12s) === RUN TestLifecyclePrivateSharedSubnet I0127 16:45:13.408791 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:45:13.408929 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:45:13.408964 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:45:13.409004 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:45:13.409045 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:45:13.409093 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:45:13.409137 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:45:13.409168 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:45:13.409207 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:45:13.409234 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0127 16:45:13.443162 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:13.446718 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.446814 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:13.446877 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.760453 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:14.939645 59286 iamrole.go:89] ListRoles: { } I0127 16:45:14.940957 59286 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0127 16:45:14.941302 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:14.941476 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0127 16:45:14.941652 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0127 16:45:14.941684 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:14.941949 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:14.943139 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:14.943666 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0127 16:45:14.943320 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:14.943948 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:45:14.943791 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0127 16:45:14.944017 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:45:14.944094 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:45:14.944157 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:14.944583 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:14.944775 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.944848 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:14.945192 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0127 16:45:14.945314 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0127 16:45:14.948855 59286 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0127 16:45:14.949016 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:45:14.949039 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0127 16:45:14.949141 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0127 16:45:14.949208 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0127 16:45:14.949119 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0127 16:45:14.949335 59286 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0127 16:45:14.949279 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0127 16:45:14.949391 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0127 16:45:14.949487 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0127 16:45:14.949464 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:14.949491 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0127 16:45:14.949656 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0127 16:45:14.949595 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:14.949664 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0127 16:45:14.949749 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:14.949798 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0127 16:45:14.950032 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0127 16:45:14.950045 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:14.950162 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:14.950219 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:14.950255 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0127 16:45:14.950374 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0127 16:45:14.950450 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0127 16:45:14.950514 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0127 16:45:14.950634 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0127 16:45:14.950725 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:45:14.950768 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:14.950804 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:14.950886 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:45:14.950930 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:45:14.950986 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:14.951097 59286 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I0127 16:45:14.951227 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:14.951307 59286 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0127 16:45:14.951622 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0127 16:45:14.952127 59286 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0127 16:45:14.952319 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } W0127 16:45:14.952520 59286 api.go:53] PageSize not implemented I0127 16:45:14.952555 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:14.952647 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:14.952561 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.952665 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:14.952758 59286 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I0127 16:45:14.952758 59286 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0127 16:45:14.952831 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:14.952773 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0127 16:45:14.952869 59286 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0127 16:45:14.952941 59286 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0127 16:45:14.952982 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0127 16:45:14.953089 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0127 16:45:14.953328 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.953466 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.953661 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:45:14.953780 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.953913 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.954048 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0127 16:45:14.954158 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.954292 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:45:14.954388 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.954517 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0127 16:45:14.954552 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.954631 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0127 16:45:14.954740 59286 api.go:53] PageSize not implemented I0127 16:45:14.954760 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:14.954696 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" }] }] } I0127 16:45:14.954829 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.954991 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.955133 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0127 16:45:14.955259 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0127 16:45:14.955419 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.955555 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0127 16:45:14.955682 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" }] }] } I0127 16:45:14.955812 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.955915 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.955995 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" }] }] } I0127 16:45:14.956165 59286 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0127 16:45:14.956206 59286 api.go:53] PageSize not implemented I0127 16:45:14.956248 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:14.956355 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0127 16:45:14.956414 59286 api.go:53] PageSize not implemented I0127 16:45:14.956532 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:14.956561 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:14.956753 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:14.956860 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:14.962069 59286 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0127 16:45:14.962276 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.962402 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.962553 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.962671 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.963134 59286 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0127 16:45:14.963391 59286 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0127 16:45:14.963623 59286 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0127 16:45:14.963683 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:14.963721 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:14.963789 59286 dns.go:235] Pre-creating DNS records I0127 16:45:14.963816 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:14.970351 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:14.973876 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.973963 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:14.974025 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.285362 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:16.469498 59286 iamrole.go:89] ListRoles: { } I0127 16:45:16.471411 59286 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0127 16:45:16.471831 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.472106 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:45:16.472223 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:45:16.472282 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:45:16.472990 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:16.473107 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.473491 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:16.476765 59286 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0127 16:45:16.476876 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0127 16:45:16.476985 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0127 16:45:16.477011 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0127 16:45:16.477011 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0127 16:45:16.477173 59286 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0127 16:45:16.477146 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0127 16:45:16.477251 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0127 16:45:16.477282 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:16.477390 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0127 16:45:16.477356 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0127 16:45:16.477478 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0127 16:45:16.477705 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:16.477771 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:45:16.477881 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0127 16:45:16.478027 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:16.478083 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0127 16:45:16.478219 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:45:16.479051 59286 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0127 16:45:16.479364 59286 api.go:53] PageSize not implemented I0127 16:45:16.479407 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.479538 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.479526 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.479552 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:16.479666 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:16.479666 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.479690 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0127 16:45:16.479734 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0127 16:45:16.479774 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0127 16:45:16.479816 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0127 16:45:16.479605 59286 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0127 16:45:16.479872 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0127 16:45:16.479950 59286 api.go:53] PageSize not implemented I0127 16:45:16.479970 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.480034 59286 executor.go:111] Tasks: 103 done / 123 total; 5 can run I0127 16:45:16.480108 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0127 16:45:16.480173 59286 api.go:53] PageSize not implemented I0127 16:45:16.480186 59286 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0127 16:45:16.480236 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.480321 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:16.480423 59286 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0127 16:45:16.480462 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.480570 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0127 16:45:16.480678 59286 api.go:53] PageSize not implemented I0127 16:45:16.480743 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.487671 59286 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0127 16:45:16.487839 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.488112 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.488296 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.488504 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.489161 59286 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0127 16:45:16.489385 59286 api.go:53] PageSize not implemented I0127 16:45:16.489415 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.489600 59286 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0127 16:45:16.489891 59286 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0127 16:45:16.493246 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:45:16.493311 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:45:16.493347 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:16.493379 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:45:16.493412 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:45:16.493445 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:45:16.493482 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:45:16.493517 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:45:16.493564 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0127 16:45:16.493599 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:45:16.493632 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:45:16.493662 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:45:16.493693 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:16.493726 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:16.493760 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:45:16.493792 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:45:16.493826 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:16.493861 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:16.493897 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:45:16.493930 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:16.493971 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:16.494007 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:45:16.495494 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:45:16.495566 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:45:16.495587 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:45:16.495628 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.495685 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0127 16:45:16.495755 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.495819 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.495861 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.495900 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.495942 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.495976 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0127 16:45:16.496015 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.496059 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0127 16:45:16.496094 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0127 16:45:16.496139 59286 api.go:53] PageSize not implemented I0127 16:45:16.496158 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0127 16:45:16.496206 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:16.496233 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:16.496250 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0127 16:45:16.496290 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:45:16.496316 59286 targetgroups.go:35] PageSize not implemented I0127 16:45:16.496334 59286 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I0127 16:45:16.496407 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:45:16.496451 59286 iamrole.go:89] ListRoles: { } I0127 16:45:16.496500 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:16.496548 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:16.496592 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:45:16.496638 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:16.497205 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0127 16:45:16.497221 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } autoscaling-group:bastion.private-shared-subnet.example.com ok autoscaling-group:nodes.private-shared-subnet.example.com ok volume:vol-1 ok I0127 16:45:16.497311 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I0127 16:45:16.497294 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:16.497365 59286 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0127 16:45:16.497390 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0127 16:45:16.497398 59286 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0127 16:45:16.497194 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:16.497460 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.private-shared-subnet.example.com ok load-balancer:api-private-shared-subnet-n2f8ak ok I0127 16:45:16.497495 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0127 16:45:16.497538 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0127 16:45:16.497514 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I0127 16:45:16.497395 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0127 16:45:16.497691 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:16.497738 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0127 16:45:16.497795 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0127 16:45:16.497948 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0127 16:45:16.498028 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:16.498111 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0127 16:45:16.498252 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:16.498279 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-3 ok I0127 16:45:16.498350 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:16.498420 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0127 16:45:16.498654 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:16.498677 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:45:16.498783 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:45:16.498824 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0127 16:45:16.498915 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0127 16:45:16.498846 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0127 16:45:16.499016 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:16.498954 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0127 16:45:16.499039 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0127 16:45:16.499073 59286 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0127 16:45:16.499100 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0127 16:45:16.499171 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I0127 16:45:16.499237 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0127 16:45:16.499283 59286 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0127 16:45:16.499298 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0127 16:45:16.499342 59286 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0127 16:45:16.499407 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0127 16:45:16.499484 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (3.09s) === RUN TestLifecyclePrivateSharedIP I0127 16:45:16.500012 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:45:16.500159 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:45:16.500200 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:45:16.500245 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:45:16.500284 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:45:16.500334 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:45:16.500376 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:45:16.500406 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:45:16.500442 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:45:16.500469 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0127 16:45:16.532884 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:16.536892 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.536985 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:16.537047 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.613477 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:17.789132 59286 iamrole.go:89] ListRoles: { } I0127 16:45:17.790567 59286 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0127 16:45:17.790799 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:17.790921 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0127 16:45:17.790938 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.790990 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0127 16:45:17.791055 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:17.791233 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:17.791335 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:17.791386 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:17.791528 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:17.791654 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:17.791690 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:45:17.791739 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:45:17.792641 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:17.792733 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0127 16:45:17.791757 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:45:17.793009 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] } I0127 16:45:17.795179 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0127 16:45:17.795367 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0127 16:45:17.798898 59286 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0127 16:45:17.799160 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0127 16:45:17.799276 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0127 16:45:17.799420 59286 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0127 16:45:17.799348 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:17.799411 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0127 16:45:17.799525 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0127 16:45:17.799492 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:17.799645 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0127 16:45:17.799620 59286 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0127 16:45:17.799671 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0127 16:45:17.799745 59286 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0127 16:45:17.799597 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0127 16:45:17.799743 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0127 16:45:17.799801 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:17.799886 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I0127 16:45:17.799944 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0127 16:45:17.800062 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:17.800142 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0127 16:45:17.800149 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0127 16:45:17.800205 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0127 16:45:17.800186 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0127 16:45:17.800300 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:17.800447 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:45:17.800550 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:17.800623 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0127 16:45:17.800737 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:17.800821 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:17.800876 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:45:17.801003 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:45:17.801062 59286 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I0127 16:45:17.801169 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0127 16:45:17.801318 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0127 16:45:17.801506 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0127 16:45:17.801737 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:17.801892 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:17.801953 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:17.802010 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:17.802104 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:45:17.802153 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:17.802191 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:17.801862 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0127 16:45:17.802244 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:17.802317 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:45:17.802376 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:17.802428 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0127 16:45:17.802526 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:45:17.802576 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:45:17.802659 59286 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0127 16:45:17.802874 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } W0127 16:45:17.803097 59286 api.go:53] PageSize not implemented I0127 16:45:17.803099 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:17.803209 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:17.803271 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:17.803219 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" }] }] } I0127 16:45:17.803328 59286 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0127 16:45:17.803374 59286 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0127 16:45:17.803437 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:17.803475 59286 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0127 16:45:17.803460 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0127 16:45:17.803537 59286 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0127 16:45:17.803607 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:17.803670 59286 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W0127 16:45:17.803767 59286 api.go:53] PageSize not implemented I0127 16:45:17.803790 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:17.803863 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.804009 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.804163 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0127 16:45:17.804315 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.804467 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:17.804609 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0127 16:45:17.804686 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:17.804755 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0127 16:45:17.804834 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:17.804918 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:17.804992 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.805137 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.805351 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.805590 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.805847 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0127 16:45:17.805993 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0127 16:45:17.806034 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0127 16:45:17.806073 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:17.806202 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0127 16:45:17.806411 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.806606 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0127 16:45:17.806721 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0127 16:45:17.806859 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:45:17.806953 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0127 16:45:17.807044 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0127 16:45:17.807220 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0127 16:45:17.807267 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.807393 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0127 16:45:17.807530 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0127 16:45:17.807657 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0127 16:45:17.807746 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:45:17.807785 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0127 16:45:17.807826 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0127 16:45:17.807962 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0127 16:45:17.808089 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" }] }] } I0127 16:45:17.808232 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:17.808277 59286 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0127 16:45:17.808367 59286 executor.go:111] Tasks: 110 done / 132 total; 6 can run I0127 16:45:17.808476 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0127 16:45:17.808563 59286 api.go:53] PageSize not implemented I0127 16:45:17.808539 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:17.808585 59286 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:17.808632 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:17.808719 59286 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }] }] } I0127 16:45:17.808716 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0127 16:45:17.808833 59286 api.go:53] PageSize not implemented I0127 16:45:17.808828 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0127 16:45:17.808845 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:17.808888 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:17.808892 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:17.808973 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:17.808928 59286 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0127 16:45:17.814645 59286 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0127 16:45:17.814738 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:17.814895 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0127 16:45:17.815068 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.815170 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.815341 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.815478 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.816261 59286 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0127 16:45:17.816622 59286 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0127 16:45:17.816966 59286 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0127 16:45:17.817019 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:17.817057 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:17.817122 59286 dns.go:235] Pre-creating DNS records I0127 16:45:17.817150 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:17.823636 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:17.827171 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.827256 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:17.827318 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.295735 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:19.486952 59286 iamrole.go:89] ListRoles: { } I0127 16:45:19.488653 59286 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0127 16:45:19.489000 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:19.489196 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0127 16:45:19.489286 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0127 16:45:19.489324 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0127 16:45:19.489832 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.490056 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.490464 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:19.491936 59286 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0127 16:45:19.492126 59286 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0127 16:45:19.492060 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0127 16:45:19.492249 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0127 16:45:19.492401 59286 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0127 16:45:19.492441 59286 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0127 16:45:19.492434 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.492517 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0127 16:45:19.492548 59286 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0127 16:45:19.492504 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0127 16:45:19.492573 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0127 16:45:19.492776 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:19.492853 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:45:19.492979 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:19.493064 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:19.493162 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0127 16:45:19.493452 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:19.493519 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.493694 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.493874 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0127 16:45:19.494033 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.494258 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0127 16:45:19.494714 59286 executor.go:111] Tasks: 74 done / 132 total; 36 can run W0127 16:45:19.495097 59286 api.go:53] PageSize not implemented I0127 16:45:19.495120 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:19.495133 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.495223 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0127 16:45:19.495269 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0127 16:45:19.495310 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:19.495336 59286 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0127 16:45:19.495332 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0127 16:45:19.495390 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0127 16:45:19.495259 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.495437 59286 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0127 16:45:19.495474 59286 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0127 16:45:19.495485 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.495513 59286 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0127 16:45:19.495549 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0127 16:45:19.495627 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } W0127 16:45:19.495659 59286 api.go:53] PageSize not implemented I0127 16:45:19.495678 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.495745 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:19.495924 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0127 16:45:19.496183 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:19.496384 59286 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0127 16:45:19.496446 59286 api.go:53] PageSize not implemented I0127 16:45:19.496482 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.496486 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:19.496503 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:19.496590 59286 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0127 16:45:19.496627 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:45:19.496628 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.496654 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0127 16:45:19.496773 59286 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" W0127 16:45:19.496795 59286 api.go:53] PageSize not implemented I0127 16:45:19.496839 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.497011 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.502566 59286 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0127 16:45:19.502677 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.502828 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.503006 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.503155 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.503308 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:19.503625 59286 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0127 16:45:19.503745 59286 api.go:53] PageSize not implemented I0127 16:45:19.503770 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.503950 59286 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0127 16:45:19.504199 59286 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0127 16:45:19.507493 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:45:19.507555 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:45:19.507592 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:19.507627 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:45:19.507664 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:45:19.507696 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:45:19.507732 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:45:19.507769 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:45:19.507811 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0127 16:45:19.507849 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0127 16:45:19.507885 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:45:19.507915 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:45:19.507946 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:19.507981 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:45:19.508012 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0127 16:45:19.508047 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:19.508086 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:19.508120 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0127 16:45:19.508154 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0127 16:45:19.508193 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:19.508230 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:19.508263 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0127 16:45:19.508297 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:19.508328 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:45:19.508360 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:19.508395 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:19.508430 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:45:19.509905 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:45:19.509978 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:45:19.509999 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:45:19.510040 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510096 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0127 16:45:19.510161 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510224 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510264 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510304 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510345 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510389 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0127 16:45:19.510443 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510495 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:19.510524 59286 natgateway.go:117] DescribeNatGateways: { } I0127 16:45:19.510565 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0127 16:45:19.510601 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0127 16:45:19.510645 59286 api.go:53] PageSize not implemented I0127 16:45:19.510662 59286 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0127 16:45:19.510705 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:19.510730 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:19.510748 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0127 16:45:19.510787 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:45:19.510810 59286 targetgroups.go:35] PageSize not implemented I0127 16:45:19.510828 59286 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0127 16:45:19.510891 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:45:19.510934 59286 iamrole.go:89] ListRoles: { } I0127 16:45:19.510982 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:19.511009 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:19.511056 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:45:19.511098 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:19.511131 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0127 16:45:19.511170 59286 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0127 16:45:19.511206 59286 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0127 16:45:19.511801 59286 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I0127 16:45:19.511839 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0127 16:45:19.511887 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0127 16:45:19.511920 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0127 16:45:19.511920 59286 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } autoscaling-config:lt-2 ok I0127 16:45:19.511983 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0127 16:45:19.511976 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:19.512028 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0127 16:45:19.512079 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0127 16:45:19.512084 59286 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0127 16:45:19.512125 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } autoscaling-group:bastion.private-shared-ip.example.com ok iam-instance-profile:bastions.private-shared-ip.example.com ok I0127 16:45:19.512065 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok W0127 16:45:19.512236 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:nodes.private-shared-ip.example.com ok I0127 16:45:19.512254 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:45:19.512085 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-ip.example.com. ok I0127 16:45:19.512299 59286 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0127 16:45:19.512395 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:45:19.512460 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0127 16:45:19.512516 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0127 16:45:19.512716 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:19.512737 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-3 ok I0127 16:45:19.512783 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:19.512829 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0127 16:45:19.512942 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:19.512961 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0127 16:45:19.513005 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0127 16:45:19.513119 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0127 16:45:19.513199 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:45:19.513157 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0127 16:45:19.513284 59286 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0127 16:45:19.513268 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0127 16:45:19.513310 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0127 16:45:19.513364 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0127 16:45:19.513379 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0127 16:45:19.513414 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0127 16:45:19.513327 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0127 16:45:19.513458 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:19.513445 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0127 16:45:19.513506 59286 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0127 16:45:19.513525 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0127 16:45:19.513476 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0127 16:45:19.513560 59286 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0127 16:45:19.513617 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0127 16:45:19.513660 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0127 16:45:19.513737 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0127 16:45:19.513827 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecyclePrivateSharedIP (3.01s) === RUN TestLifecycleManyAddons I0127 16:45:19.514353 59286 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:45:19.514489 59286 internetgateways.go:66] CreateInternetGateway: { } I0127 16:45:19.514532 59286 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:45:19.514576 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:45:19.514615 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:45:19.514664 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:45:19.514705 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:45:19.514735 59286 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:45:19.514776 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:45:19.514803 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0127 16:45:19.547271 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:19.550801 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:19.550896 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:20.888690 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:21.711528 59286 iamrole.go:89] ListRoles: { } I0127 16:45:21.712550 59286 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0127 16:45:21.712815 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.713061 59286 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.713230 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:45:21.713188 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0127 16:45:21.713306 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0127 16:45:21.713308 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.713482 59286 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.713527 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:21.713582 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0127 16:45:21.713638 59286 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0127 16:45:21.713657 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:45:21.713729 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:21.714644 59286 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0127 16:45:21.714750 59286 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0127 16:45:21.714736 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.715062 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:21.715333 59286 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.715488 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.715578 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:21.716078 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:21.716150 59286 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0127 16:45:21.716293 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:21.721355 59286 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0127 16:45:21.721565 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0127 16:45:21.721636 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.721753 59286 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0127 16:45:21.721770 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0127 16:45:21.721846 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:45:21.721910 59286 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0127 16:45:21.721907 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.722088 59286 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:45:21.722173 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:21.722467 59286 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I0127 16:45:21.722449 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0127 16:45:21.722572 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:45:21.722769 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0127 16:45:21.722986 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:21.723206 59286 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:45:21.723282 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:21.723392 59286 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.723562 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:21.723641 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:21.723694 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" }] }], VpcId: "vpc-1" } I0127 16:45:21.723809 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:21.723884 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:21.723940 59286 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0127 16:45:21.724026 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:21.724070 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:21.724105 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:21.724150 59286 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] } I0127 16:45:21.724253 59286 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0127 16:45:21.724320 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:45:21.725497 59286 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:45:21.728285 59286 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0127 16:45:21.728554 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.728810 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.729012 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:21.729162 59286 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:45:21.729219 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.729352 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:21.729456 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:21.729706 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.729916 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.730146 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.730325 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:21.730404 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:21.730471 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.730681 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0127 16:45:21.730895 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.731073 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.731243 59286 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0127 16:45:21.731320 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.731483 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.731640 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0127 16:45:21.731805 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:21.731923 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:21.732011 59286 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" }] }] } I0127 16:45:21.732255 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0127 16:45:21.732335 59286 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0127 16:45:21.732405 59286 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0127 16:45:21.732702 59286 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0127 16:45:21.733019 59286 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0127 16:45:21.733322 59286 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0127 16:45:21.733381 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:21.733422 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:21.733495 59286 dns.go:235] Pre-creating DNS records I0127 16:45:21.733527 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:21.740224 59286 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0127 16:45:21.743888 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:21.743989 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:23.069060 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:23.887150 59286 iamrole.go:89] ListRoles: { } I0127 16:45:23.888143 59286 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0127 16:45:23.888344 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.888551 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I0127 16:45:23.888816 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.889809 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0127 16:45:23.889987 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:45:23.890026 59286 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:45:23.890085 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:23.890430 59286 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0127 16:45:23.892392 59286 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0127 16:45:23.897829 59286 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0127 16:45:23.898090 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.898281 59286 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0127 16:45:23.898301 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.898470 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:23.898625 59286 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0127 16:45:23.898616 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.898780 59286 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:45:23.898843 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0127 16:45:23.899151 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:23.899252 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0127 16:45:23.899495 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0127 16:45:23.899596 59286 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:45:23.904473 59286 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0127 16:45:23.904642 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:23.904747 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:23.904956 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:23.905138 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:23.905269 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:23.905453 59286 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0127 16:45:23.905679 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:23.905929 59286 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0127 16:45:23.906226 59286 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0127 16:45:23.906564 59286 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0127 16:45:23.909485 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0127 16:45:23.909550 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0127 16:45:23.909590 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0127 16:45:23.909623 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0127 16:45:23.909656 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0127 16:45:23.909689 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0127 16:45:23.909721 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0127 16:45:23.909757 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0127 16:45:23.909793 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0127 16:45:23.909833 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0127 16:45:23.909905 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0127 16:45:23.909937 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0127 16:45:23.909969 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0127 16:45:23.910005 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0127 16:45:23.910037 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:45:23.910071 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0127 16:45:23.910120 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:45:23.910156 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0127 16:45:23.910188 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0127 16:45:23.910228 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0127 16:45:23.910260 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0127 16:45:23.910299 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0127 16:45:23.910335 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:45:23.910369 59286 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0127 16:45:23.912028 59286 delete_cluster.go:128] Looking for cloud resources to delete W0127 16:45:23.912093 59286 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0127 16:45:23.912113 59286 keypairs.go:95] DescribeKeyPairs: { } I0127 16:45:23.912158 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912211 59286 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0127 16:45:23.912266 59286 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912322 59286 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912371 59286 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912423 59286 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912468 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912518 59286 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0127 16:45:23.912567 59286 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912614 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0127 16:45:23.912653 59286 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0127 16:45:23.912694 59286 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0127 16:45:23.912736 59286 api.go:53] PageSize not implemented I0127 16:45:23.912759 59286 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0127 16:45:23.912786 59286 loadbalancers.go:35] PageSize not implemented I0127 16:45:23.912805 59286 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0127 16:45:23.912829 59286 targetgroups.go:35] PageSize not implemented I0127 16:45:23.912847 59286 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0127 16:45:23.912902 59286 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0127 16:45:23.912936 59286 iamrole.go:89] ListRoles: { } I0127 16:45:23.912982 59286 zones.go:93] ListHostedZonesPages { } I0127 16:45:23.913012 59286 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0127 16:45:23.913054 59286 internetgateways.go:101] DescribeInternetGateways: { } I0127 16:45:23.913101 59286 routetable.go:53] DescribeRouteTables: { } I0127 16:45:23.913135 59286 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0127 16:45:23.913585 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:45:23.913648 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0127 16:45:23.913647 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0127 16:45:23.913737 59286 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0127 16:45:23.913767 59286 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:45:23.913814 59286 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0127 16:45:23.913804 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } volume:vol-1 ok autoscaling-group:nodes.minimal.example.com ok I0127 16:45:23.913762 59286 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I0127 16:45:23.913890 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0127 16:45:23.914024 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:23.914051 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0127 16:45:23.914093 59286 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0127 16:45:23.914166 59286 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0127 16:45:23.914388 59286 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0127 16:45:23.914412 59286 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0127 16:45:23.914467 59286 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0127 16:45:23.914525 59286 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0127 16:45:23.914580 59286 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0127 16:45:23.914666 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0127 16:45:23.914715 59286 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0127 16:45:23.914732 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0127 16:45:23.914716 59286 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0127 16:45:23.914772 59286 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0127 16:45:23.914807 59286 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0127 16:45:23.914891 59286 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0127 16:45:23.914912 59286 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0127 16:45:23.914954 59286 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0127 16:45:23.915033 59286 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0127 16:45:23.915116 59286 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0127 16:45:23.915191 59286 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (4.40s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 219.074s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.004s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0127 16:41:45.755190 59626 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0127 16:41:45.778391 59628 pod.go:59] starting pod controller I0127 16:41:45.778587 59628 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0127 16:41:45.778676 59628 pod.go:107] Got stop signal ok k8s.io/kops/dns-controller/pkg/watchers 0.029s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000373d0} route53_test.go:93: Got zone list: [0xc000037400] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc0000960c8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037530} route53_test.go:93: Got zone list: [0xc000037560] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc0000960e0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000037660} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003eae40 0xc000096100} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037820} route53_test.go:93: Got zone list: [0xc000037850] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096120} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000379b0} route53_test.go:93: Got zone list: [0xc0000379e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096148} route53_test.go:187: Successfully added resource record set: {0xc000402000 0xc000096168} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037cc0} route53_test.go:93: Got zone list: [0xc000037cf0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc0000961f8} route53_test.go:199: Successfully added resource record set: {0xc0004021b0 0xc000096218} route53_test.go:118: Got 1 recordsets: [0xc000037e90] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000408020} route53_test.go:93: Got zone list: [0xc000408050] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc0000962b8} route53_test.go:221: Successfully added resource record set: {0xc000402360 0xc0000962d8} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000402360 0xc0000962d8}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000408410} route53_test.go:93: Got zone list: [0xc000408440] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096398} route53_test.go:246: Successfully removed resource set {0xc0004025a0 0xc0000963b8} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000408720} route53_test.go:93: Got zone list: [0xc000408750] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096448} route53_test.go:264: Successfully removed resource set {0xc000402750 0xc000096468} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000408a60} route53_test.go:93: Got zone list: [0xc000408a90] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096500} commontests.go:192: Successfully added resource record set: {0xc000402900 0xc000096520} commontests.go:45: Correctly replaced resource record {0xc000402900 0xc000096520} -> {0xc000402a20 0xc000096570} commontests.go:142: Got 1 recordsets: [0xc000408da0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000408fd0} route53_test.go:93: Got zone list: [0xc000409000] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096628} commontests.go:192: Successfully added resource record set: {0xc000402cf0 0xc000096648} commontests.go:70: Correctly replaced resource record {0xc000402cf0 0xc000096648} -> {0xc000402e10 0xc000096698} commontests.go:142: Got 1 recordsets: [0xc000409310] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000409590} route53_test.go:93: Got zone list: [0xc0004095c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096760} commontests.go:192: Successfully added resource record set: {0xc0004030e0 0xc000096780} commontests.go:142: Got 2 recordsets: [0xc000409830 0xc000409850] commontests.go:142: Got 2 recordsets: [0xc0004098c0 0xc0004098e0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000409ae0} route53_test.go:93: Got zone list: [0xc000409b10] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eac00 0xc000096888} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.013s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.005s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc0003843c0} clouddns_test.go:71: Got zone list: [0xc000700240] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700210} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc0003844c0} clouddns_test.go:71: Got zone list: [0xc000700300] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc0007002d0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc0003845c0} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc00028ca00 0xc0007003c0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000384680} clouddns_test.go:71: Got zone list: [0xc000700480] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700450} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc0003847a0} clouddns_test.go:71: Got zone list: [0xc0007005b8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700588} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc0003848e0} clouddns_test.go:71: Got zone list: [0xc000700720] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc0007006f0} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000384a40} clouddns_test.go:71: Got zone list: [0xc000700930] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700900} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000384ba0} clouddns_test.go:71: Got zone list: [0xc000700ac8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700a98} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000384ce0} clouddns_test.go:71: Got zone list: [0xc000700c30] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700c00} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000384e40} clouddns_test.go:71: Got zone list: [0xc000700df8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000700dc8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000384fa0} clouddns_test.go:71: Got zone list: [0xc0007010c8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc000701098} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000385120} clouddns_test.go:71: Got zone list: [0xc0007013f8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc0007013c8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000000010 0xc000385300} clouddns_test.go:71: Got zone list: [0xc0007017d0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00028c880 0xc0007017a0} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.062s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.023s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.006s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.068s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0127 16:41:55.451382 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.451537 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.451578 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.451621 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.451653 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.451702 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.451737 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.451755 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.451799 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.451847 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.460098 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0127 16:41:55.463697 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.463773 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.463796 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.463819 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.463837 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.463865 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.463886 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.463900 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.463920 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.463935 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.464901 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0127 16:41:55.468056 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.468143 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.468171 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.468207 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.468239 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.468281 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.468315 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.468338 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.468368 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.468395 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.469458 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.471340 60300 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0127 16:41:55.471363 60300 assetstore.go:111] bin/containerd I0127 16:41:55.471373 60300 assetstore.go:111] bin/containerd-shim I0127 16:41:55.471383 60300 assetstore.go:111] bin/containerd-shim-runc-v1 I0127 16:41:55.471392 60300 assetstore.go:111] bin/containerd-shim-runc-v2 I0127 16:41:55.471402 60300 assetstore.go:111] bin/containerd-stress I0127 16:41:55.471412 60300 assetstore.go:111] bin/ctr I0127 16:41:55.471458 60300 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0127 16:41:55.471476 60300 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0127 16:41:55.476205 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.476299 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.476333 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.476372 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.476403 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.476458 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.476491 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.476519 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.476565 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.476588 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.478036 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.480019 60300 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0127 16:41:55.481153 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.481259 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.481286 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.481327 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.481352 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.481392 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.481457 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.481472 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.481493 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.481512 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.482973 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.485221 60300 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0127 16:41:55.486128 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.486236 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.486272 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.486312 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.486348 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.486389 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.486459 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.486487 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.486521 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.486563 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.488080 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.490393 60300 assetstore.go:108] Matching assets for "^docker/": I0127 16:41:55.490418 60300 assetstore.go:111] docker/containerd I0127 16:41:55.490433 60300 assetstore.go:111] docker/containerd-shim I0127 16:41:55.490445 60300 assetstore.go:111] docker/ctr I0127 16:41:55.490457 60300 assetstore.go:111] docker/docker I0127 16:41:55.490468 60300 assetstore.go:111] docker/docker-init I0127 16:41:55.490479 60300 assetstore.go:111] docker/docker-proxy I0127 16:41:55.490490 60300 assetstore.go:111] docker/dockerd I0127 16:41:55.490503 60300 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I0127 16:41:55.494408 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.494526 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.494566 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.494610 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.494648 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.494695 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.494773 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.494802 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.494837 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.494864 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.496352 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.498606 60300 assetstore.go:108] Matching assets for "^docker/": I0127 16:41:55.498629 60300 assetstore.go:111] docker/containerd I0127 16:41:55.498642 60300 assetstore.go:111] docker/containerd-shim I0127 16:41:55.498654 60300 assetstore.go:111] docker/ctr I0127 16:41:55.498664 60300 assetstore.go:111] docker/docker I0127 16:41:55.498675 60300 assetstore.go:111] docker/docker-init I0127 16:41:55.498689 60300 assetstore.go:111] docker/docker-proxy I0127 16:41:55.498700 60300 assetstore.go:111] docker/dockerd I0127 16:41:55.498711 60300 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I0127 16:41:55.502107 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.502204 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.502236 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.502266 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.502287 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.502323 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.502373 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.502396 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.502417 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.502440 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.503480 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.504865 60300 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0127 16:41:55.505030 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.505121 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.505144 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.505168 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.505187 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.505221 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.505264 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.505278 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.505312 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.505331 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.506148 60300 zones.go:93] ListHostedZonesPages { } I0127 16:41:55.507416 60300 assetstore.go:108] Matching assets for "^docker/": I0127 16:41:55.507430 60300 assetstore.go:111] docker/docker I0127 16:41:55.507437 60300 assetstore.go:111] docker/docker-containerd I0127 16:41:55.507443 60300 assetstore.go:111] docker/docker-containerd-ctr I0127 16:41:55.507449 60300 assetstore.go:111] docker/docker-containerd-shim I0127 16:41:55.507455 60300 assetstore.go:111] docker/docker-init I0127 16:41:55.507460 60300 assetstore.go:111] docker/docker-proxy I0127 16:41:55.507466 60300 assetstore.go:111] docker/docker-runc I0127 16:41:55.507471 60300 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0127 16:41:55.511440 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.511541 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.511572 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.511605 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.511630 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.511665 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.511689 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.511706 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.511735 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.511751 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.516527 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I0127 16:41:55.520039 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.520152 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.520186 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.520233 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.520270 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.520312 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.520354 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.520384 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.520419 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.520444 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.523166 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0127 16:41:55.525553 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.525626 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.525649 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.525675 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.525695 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.525720 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.525742 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.525758 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.525780 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.525794 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.527299 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0127 16:41:55.535845 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.535933 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.535956 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.535983 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.536004 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.536029 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.536051 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.536066 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.536086 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.536101 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.537924 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0127 16:41:55.547089 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.547185 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.547213 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.547245 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.547270 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.547301 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.547330 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.547349 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.547372 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.547389 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.549706 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0127 16:41:55.560882 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.561012 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.561052 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.561104 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.561149 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.561201 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.561245 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.561278 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.561317 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.561351 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.564716 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.02s) === RUN TestDeddicatedAPIServerBuilder I0127 16:41:55.576850 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.576975 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.577020 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.577067 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.577112 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.577163 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.577210 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.577243 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.577283 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.577313 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.580361 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.02s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0127 16:41:55.592399 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.592580 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.592657 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.592739 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.592815 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.592903 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.592985 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.593053 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.593130 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.593222 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.596054 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.02s) === RUN TestAwsIamAuthenticator I0127 16:41:55.608641 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.608763 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.608799 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.608848 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.609027 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.609122 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.609214 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.609248 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.609333 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.610974 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.613465 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0127 16:41:55.623164 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:55.623271 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:55.623302 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:55.623332 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:55.623356 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:55.623388 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:55.623416 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:55.623439 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:55.623480 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:55.623508 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:55.626481 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.98s) === RUN TestKubeAPIServerBuilderARM64 I0127 16:41:57.600396 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:57.600481 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:57.600508 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:57.600541 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:57.600565 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:57.600595 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:57.600619 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:57.600636 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:57.600659 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:57.600676 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:57.602333 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.23s) === RUN TestKubeControllerManagerBuilder I0127 16:41:58.831363 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:58.831468 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:58.831503 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:58.831551 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:58.831588 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:58.831638 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:58.831675 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:58.831705 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:58.831745 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:58.831772 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:58.833604 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0127 16:41:58.840187 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:41:58.840283 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:41:58.840317 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:41:58.840359 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:41:58.840398 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:41:58.840447 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:41:58.840483 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:41:58.840515 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:41:58.840556 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:41:58.840588 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:41:58.842356 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.22s) === RUN TestKubeControllerManagerBuilderARM64 I0127 16:42:00.060811 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:00.060904 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:00.060933 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:00.060968 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:00.060994 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:00.061027 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:00.061054 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:00.061073 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:00.061096 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:00.061115 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:00.062989 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.22s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0127 16:42:01.284311 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:01.284439 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:01.284478 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:01.284525 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:01.284562 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:01.284607 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:01.284648 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:01.284675 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:01.284711 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:01.284738 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:01.287594 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0127 16:42:01.293468 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:01.293591 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:01.293628 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:01.293671 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:01.293710 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:01.293758 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:01.293796 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:01.293836 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:01.293872 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:01.293900 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:01.296644 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.21s) === RUN TestKubeProxyBuilderARM64 I0127 16:42:02.507948 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:02.508071 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:02.508108 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:02.508153 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:02.508195 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:02.508241 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:02.508283 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:02.508311 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:02.508349 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:02.508375 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:02.511190 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.26s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0127 16:42:03.773535 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:03.773697 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:03.773767 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:03.773843 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:03.773916 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:03.773996 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:03.774072 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:03.774134 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:03.774204 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:03.774265 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:03.777348 60300 zones.go:93] ListHostedZonesPages { } W0127 16:42:03.781746 60300 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0127 16:42:03.784735 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:03.784861 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:03.784901 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:03.784947 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:03.784996 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:03.785050 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:03.785095 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:03.785118 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:03.785148 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:03.785178 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:03.788150 60300 zones.go:93] ListHostedZonesPages { } W0127 16:42:05.089086 60300 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.31s) === RUN TestKubeSchedulerBuilderARM64 I0127 16:42:05.090815 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:05.090908 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:05.090938 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:05.090972 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:05.090997 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:05.091029 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:05.091057 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:05.091075 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:05.091097 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:05.091116 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:05.092902 60300 zones.go:93] ListHostedZonesPages { } W0127 16:42:06.305911 60300 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.22s) === RUN TestKubectlBuilder I0127 16:42:06.307640 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.307730 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.307759 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.307792 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.307818 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.307850 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.307877 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.307894 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.307918 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.307934 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.309661 60300 zones.go:93] ListHostedZonesPages { } I0127 16:42:06.311420 60300 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0127 16:42:06.313352 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.313441 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.313468 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.313497 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.313525 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.313557 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.313583 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.313601 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.313626 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.313643 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.315003 60300 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0127 16:42:06.318539 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.318625 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.318651 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.318682 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.318705 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.318734 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.318760 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.318777 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.318802 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.318819 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.320155 60300 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.00s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0127 16:42:06.323542 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.323632 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.323657 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.323685 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.323707 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.323738 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.323769 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.323786 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.323810 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.323828 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.325547 60300 zones.go:93] ListHostedZonesPages { } I0127 16:42:06.327536 60300 assetstore.go:108] Matching assets for "protokube$": I0127 16:42:06.327555 60300 assetstore.go:111] /opt/kops/bin/protokube I0127 16:42:06.327565 60300 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0127 16:42:06.327588 60300 assetstore.go:108] Matching assets for "channels$": I0127 16:42:06.327597 60300 assetstore.go:111] /opt/kops/bin/channels I0127 16:42:06.327605 60300 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0127 16:42:06.328885 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.328963 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.328986 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.329012 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.329033 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.329059 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.329082 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.329100 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.329123 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.329140 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.330692 60300 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.00s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0127 16:42:06.332719 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.332780 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.332800 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.332823 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.332858 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.332884 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.332906 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.332925 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.332945 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.332959 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.334986 60300 zones.go:93] ListHostedZonesPages { } I0127 16:42:06.338643 60300 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0127 16:42:06.339266 60300 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:06.339379 60300 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:06.339413 60300 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:06.339458 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:06.339494 60300 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:06.339538 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:06.339573 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:06.339602 60300 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:06.339639 60300 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:06.339664 60300 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:06.342168 60300 zones.go:93] ListHostedZonesPages { } I0127 16:42:06.344706 60300 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.01s) PASS ok k8s.io/kops/nodeup/pkg/model 10.979s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.038s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.026s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.032s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0127 16:41:55.384443 60304 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0127 16:41:55.384638 60304 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.010s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0127 16:41:55.443696 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.443803 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.443847 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.443890 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.443930 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0127 16:41:55.444187 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444238 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444274 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444302 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444335 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444415 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444488 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444565 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444652 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444721 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444778 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444845 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444903 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.444957 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.445011 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.445110 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.445170 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.445237 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0127 16:41:55.445294 60305 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0127 16:41:55.445574 60305 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0127 16:41:55.445657 60305 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.084s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.013s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0127 16:41:55.420030 60307 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0127 16:41:55.421256 60307 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0127 16:41:55.422564 60307 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0127 16:41:55.423998 60307 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0127 16:41:55.424973 60307 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0127 16:41:55.425982 60307 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W0127 16:41:55.426972 60307 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0127 16:41:55.427899 60307 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0127 16:41:55.427917 60307 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0127 16:41:55.427929 60307 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0127 16:41:55.427943 60307 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.054s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.078s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.028s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.01s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.147s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.125s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.040s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.02s) --- PASS: TestHasExtraFields/minimal (0.02s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.085s === RUN TestFlagToFalse I0127 16:42:02.855552 61682 featureflag_test.go:32] Created flag Unittest1 I0127 16:42:02.855603 61682 featureflag.go:164] FeatureFlag "UnitTest1"=false I0127 16:42:02.855614 61682 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0127 16:42:02.855677 61682 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.047s === RUN TestRenderInstanceGroupZones W0127 16:42:02.893320 61684 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.047s === RUN TestWarmPoolOnlyRoll I0127 16:42:15.308137 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.308227 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.308250 62197 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0127 16:42:15.308723 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.308762 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.309901 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.309924 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.315095 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.315124 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.315135 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.315144 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.316627 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.317145 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.317241 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.317265 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.318381 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.318403 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.323577 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.323618 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:15.324133 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:15.324182 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.324215 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.325329 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.325350 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.330537 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.330563 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.330574 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.330582 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.331136 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.331554 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.331575 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.332683 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.332704 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.337881 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.337921 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.338457 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.338480 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.339614 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.339637 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.344813 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.344844 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.345383 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.345406 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.346523 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.346567 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.351793 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.351816 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.351827 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.351842 62197 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0127 16:42:15.352430 62197 instancegroups.go:431] Draining the node: "node-2a.local". I0127 16:42:15.352906 62197 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0127 16:42:15.352929 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.354044 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.354068 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.359275 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.359333 62197 instancegroups.go:431] Draining the node: "node-2b.local". I0127 16:42:15.360240 62197 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0127 16:42:15.360278 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.361399 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.361425 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.366575 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.366638 62197 instancegroups.go:431] Draining the node: "node-2c.local". I0127 16:42:15.367592 62197 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0127 16:42:15.367629 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.368744 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.368768 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.373997 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.374031 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0127 16:42:15.374387 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.374409 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.375533 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.375567 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.375592 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.375601 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.375620 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.376722 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.376775 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.376791 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.376817 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.377953 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.377979 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.378017 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.378032 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.378054 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.379202 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.379229 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.379238 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.379254 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.380350 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.380377 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.380385 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.380400 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.381496 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.381514 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.381547 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.381559 62197 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0127 16:42:15.381575 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.382707 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.382737 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.382748 62197 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0127 16:42:15.382764 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.383866 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0127 16:42:15.383906 62197 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0127 16:42:15.383920 62197 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0127 16:42:15.383942 62197 instancegroups.go:469] waiting for 1ms after terminating instance W0127 16:42:15.385479 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0127 16:42:15.385514 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0127 16:42:15.385865 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.385899 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.387040 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.387088 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.387114 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.387175 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.387197 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.387213 62197 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.387226 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.387999 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.388685 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.388752 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.388782 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.389904 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.389940 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.389963 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.390002 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:15.390859 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:15.390924 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.390955 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.392078 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.392108 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.392126 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.392147 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.392167 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.392183 62197 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.392197 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.393116 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.393850 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.393882 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.395017 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.395052 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.395073 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.395110 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.395923 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.395956 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.397108 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.397132 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.397150 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.397174 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.397670 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.397695 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.398838 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.398872 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.398905 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.398922 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.398944 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.398960 62197 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.398976 62197 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0127 16:42:15.399972 62197 instancegroups.go:431] Draining the node: "node-2a.local". I0127 16:42:15.400755 62197 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0127 16:42:15.400790 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.401953 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.401983 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.401998 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.402028 62197 instancegroups.go:431] Draining the node: "node-2b.local". I0127 16:42:15.402592 62197 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0127 16:42:15.402615 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.403739 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.403773 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.403812 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.403851 62197 instancegroups.go:431] Draining the node: "node-2c.local". I0127 16:42:15.404643 62197 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0127 16:42:15.404676 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.405831 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.405856 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0127 16:42:15.405870 62197 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0127 16:42:15.405885 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0127 16:42:15.406114 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0127 16:42:15.406312 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.406334 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.407476 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.407501 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.412685 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.412738 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.412752 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.412761 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.413329 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.413996 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.414068 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.414096 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.415260 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.415302 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.420478 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.420529 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:15.421176 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:15.421238 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.421261 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.422373 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.422393 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.427564 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.427610 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.427623 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.427631 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.428296 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.428801 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.428828 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.429971 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.430002 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.435196 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.435252 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.436066 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.436324 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.438662 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.438724 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.443881 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.443985 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.444662 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.444689 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.445840 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.445882 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.451134 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.451183 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.451204 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.451217 62197 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0127 16:42:15.452079 62197 instancegroups.go:431] Draining the node: "node-2a.local". I0127 16:42:15.452560 62197 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0127 16:42:15.452586 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.453721 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.453753 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.458968 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.459065 62197 instancegroups.go:431] Draining the node: "node-2b.local". I0127 16:42:15.459983 62197 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0127 16:42:15.460026 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.461204 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.461255 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.466480 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.466576 62197 instancegroups.go:431] Draining the node: "node-2c.local". I0127 16:42:15.467550 62197 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0127 16:42:15.467591 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.468723 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.468753 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.474027 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.474084 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I0127 16:42:15.474278 62197 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0127 16:42:15.474741 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.474774 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.475893 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.475938 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.475958 62197 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0127 16:42:15.476255 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.476276 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.477414 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.477445 62197 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0127 16:42:15.477466 62197 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0127 16:42:15.477701 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.477726 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.477744 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.477759 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0127 16:42:15.477933 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.477956 62197 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0127 16:42:15.477975 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.477992 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0127 16:42:15.478239 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.478269 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.479409 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.479436 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.484662 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.484747 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.484775 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.484792 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.485614 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.486347 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.486420 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.486452 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.487591 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.487632 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.487654 62197 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0127 16:42:15.487990 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.488023 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.489200 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.489244 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.494445 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.494539 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.494563 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.494576 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.495192 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.495627 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.495680 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.495701 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.496821 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.496848 62197 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0127 16:42:15.496863 62197 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0127 16:42:15.497076 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.497093 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.497101 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.497709 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.498137 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.498161 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.499276 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.499302 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.504486 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.504541 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.505150 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.505184 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.506308 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.506333 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.511776 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.511845 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.512666 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.512699 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.513815 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.513836 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.519012 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.519038 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0127 16:42:15.519258 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.519275 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.519286 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.519295 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0127 16:42:15.519431 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.519446 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.519455 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.519463 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0127 16:42:15.519594 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.519609 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.519617 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.519625 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0127 16:42:15.519789 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.519809 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.519821 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.520476 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.521223 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.521260 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.522398 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.522425 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.527638 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.527689 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.528521 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.528555 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.529704 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.529723 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.534929 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.534986 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.535822 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.535857 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.537005 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.537034 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.542252 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.542294 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.542320 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.542341 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.542365 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0127 16:42:15.542645 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.542675 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.542690 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.543797 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.544552 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.544593 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.545725 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.545762 62197 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0127 16:42:15.545781 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.545799 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0127 16:42:15.545999 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.546026 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.546039 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.546991 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.547692 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.547722 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.548867 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.548890 62197 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0127 16:42:15.548903 62197 instancegroups.go:509] Cluster did not validate within 0s E0127 16:42:15.548913 62197 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0127 16:42:15.549095 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.549115 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.550239 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.550274 62197 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0127 16:42:15.551418 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.556591 62197 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0127 16:42:15.557747 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.562965 62197 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0127 16:42:15.564102 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.569326 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.569401 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.569426 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.569451 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.570230 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.570867 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.570931 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.570960 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.572074 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.572099 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.577307 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.577360 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:15.578096 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:15.578158 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.578186 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.579311 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.579349 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.584564 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.584606 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.584640 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.584658 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.585866 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.586788 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.586825 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.587965 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.588012 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.594166 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.594233 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.595186 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.595223 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.596380 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.596436 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.601643 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.601692 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.602625 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.602663 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.603812 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.603868 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.609124 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.609169 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.609217 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.609237 62197 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0127 16:42:15.610137 62197 instancegroups.go:431] Draining the node: "node-2a.local". I0127 16:42:15.610810 62197 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0127 16:42:15.610845 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.611996 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.612039 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.617239 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.617288 62197 instancegroups.go:431] Draining the node: "node-2b.local". I0127 16:42:15.618058 62197 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0127 16:42:15.618089 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.619224 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.619251 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.624434 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.624464 62197 instancegroups.go:431] Draining the node: "node-2c.local". I0127 16:42:15.624941 62197 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0127 16:42:15.624962 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.626104 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.626135 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.631325 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.631350 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0127 16:42:15.631563 62197 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0127 16:42:15.631582 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.632743 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.632784 62197 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0127 16:42:15.633931 62197 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0127 16:42:15.635048 62197 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0127 16:42:15.636158 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.641347 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.641418 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.641436 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.641447 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.642026 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.642457 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.642519 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.642550 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.643674 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.643696 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.648881 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.648934 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:15.649497 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:15.649554 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.649584 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.650743 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.650774 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.658067 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.658120 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.658137 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.658148 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.658884 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.659344 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.659370 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.660475 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.660498 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.665597 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.665646 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.666206 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.666231 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.667346 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.667365 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.672524 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.672568 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.673389 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.673424 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.674574 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.674597 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.679901 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.679927 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.679939 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.679948 62197 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0127 16:42:15.680538 62197 instancegroups.go:431] Draining the node: "node-2a.local". I0127 16:42:15.680979 62197 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0127 16:42:15.681003 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.682127 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.682153 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.687345 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.687377 62197 instancegroups.go:431] Draining the node: "node-2b.local". I0127 16:42:15.687840 62197 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0127 16:42:15.687861 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.688978 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.688998 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.694179 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.694217 62197 instancegroups.go:431] Draining the node: "node-2c.local". I0127 16:42:15.694755 62197 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0127 16:42:15.694779 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.695923 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.695943 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.701121 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.701147 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0127 16:42:15.701558 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.701573 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.701581 62197 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0127 16:42:15.702010 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.702441 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.702462 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.703565 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.703589 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.708774 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.708803 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.709283 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.709306 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.710444 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.710463 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.715640 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.715663 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0127 16:42:15.715847 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.715862 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.715869 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.716309 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:15.716746 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:15.716784 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:15.716799 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.717947 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.717967 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.723170 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.723220 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:15.723747 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:15.723794 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:15.723814 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.724954 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.724974 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.730162 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.730193 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0127 16:42:15.730444 62197 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0127 16:42:15.730470 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0127 16:42:15.730483 62197 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0127 16:42:15.730493 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0127 16:42:15.730505 62197 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0127 16:42:15.730511 62197 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0127 16:42:15.730523 62197 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0127 16:42:15.730537 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0127 16:42:15.730703 62197 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0127 16:42:15.730740 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:15.731846 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.731872 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.737076 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.737122 62197 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0127 16:42:15.737182 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.737204 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.737216 62197 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0127 16:42:15.737869 62197 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0127 16:42:15.737894 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.737912 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.737925 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:15.738668 62197 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0127 16:42:15.738738 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:15.739924 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.739945 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.745124 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.745152 62197 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0127 16:42:15.745164 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.745175 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.745185 62197 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0127 16:42:15.745762 62197 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0127 16:42:15.745802 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:15.746917 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.746943 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:15.752153 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.752182 62197 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0127 16:42:15.752197 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0127 16:42:15.752407 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.752430 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.752438 62197 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0127 16:42:15.753764 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.754225 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.754255 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.755376 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.755402 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.755423 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:15.755454 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.756167 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:15.756338 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.756364 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.757478 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.757519 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.858067 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.858165 62197 instancegroups.go:431] Draining the node: "node-1e.local". I0127 16:42:15.858210 62197 instancegroups.go:431] Draining the node: "node-1d.local". I0127 16:42:15.859379 62197 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0127 16:42:15.859709 62197 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0127 16:42:15.859769 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.860948 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.860986 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.861021 62197 instancegroups.go:431] Draining the node: "node-1f.local". I0127 16:42:15.861777 62197 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0127 16:42:15.861818 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.862954 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.863018 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.963479 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.963542 62197 instancegroups.go:431] Draining the node: "node-1g.local". I0127 16:42:15.964135 62197 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0127 16:42:15.964171 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.965299 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.965328 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.965341 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0127 16:42:15.965525 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.965546 62197 instancegroups.go:540] Cluster validated. I0127 16:42:15.965555 62197 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0127 16:42:15.966565 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:15.966593 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:15.967308 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:15.967456 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:15.967481 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:15.968625 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:15.968665 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.069074 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.069144 62197 instancegroups.go:431] Draining the node: "node-1d.local". I0127 16:42:16.069144 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:16.070084 62197 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0127 16:42:16.070254 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:16.070284 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.071438 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.071468 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.071492 62197 instancegroups.go:431] Draining the node: "node-1e.local". I0127 16:42:16.072008 62197 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0127 16:42:16.072035 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.073173 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.073231 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.173637 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.173718 62197 instancegroups.go:431] Draining the node: "node-1f.local". I0127 16:42:16.174632 62197 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0127 16:42:16.174682 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.175840 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.175869 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.175885 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0127 16:42:16.176048 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.176067 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.176075 62197 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0127 16:42:16.177217 62197 instancegroups.go:431] Draining the node: "master-1a.local". I0127 16:42:16.177616 62197 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0127 16:42:16.177652 62197 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0127 16:42:16.177674 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.178802 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.178838 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.178876 62197 instancegroups.go:431] Draining the node: "master-1c.local". I0127 16:42:16.178930 62197 instancegroups.go:431] Draining the node: "master-1b.local". I0127 16:42:16.179766 62197 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0127 16:42:16.179808 62197 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0127 16:42:16.179959 62197 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0127 16:42:16.179990 62197 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0127 16:42:16.180014 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.181160 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.181197 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.281630 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.281706 62197 instancegroups.go:431] Draining the node: "master-1e.local". I0127 16:42:16.281733 62197 instancegroups.go:431] Draining the node: "master-1d.local". I0127 16:42:16.283725 62197 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0127 16:42:16.283835 62197 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0127 16:42:16.287474 62197 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0127 16:42:16.287549 62197 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0127 16:42:16.287587 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.288770 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.288837 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.288931 62197 instancegroups.go:431] Draining the node: "master-1f.local". I0127 16:42:16.289806 62197 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0127 16:42:16.289892 62197 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0127 16:42:16.289937 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.291062 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.291114 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.391538 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.391626 62197 instancegroups.go:431] Draining the node: "master-1g.local". I0127 16:42:16.392509 62197 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0127 16:42:16.392586 62197 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0127 16:42:16.392631 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.393747 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.393785 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.393804 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.22s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0127 16:42:16.394071 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.394108 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.394123 62197 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0127 16:42:16.395680 62197 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0127 16:42:16.395744 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.396948 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.397009 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.397029 62197 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0127 16:42:16.397100 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.398238 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.398273 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.398312 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:16.398342 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:16.399357 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:16.399603 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:16.399646 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.400803 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.400849 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.501248 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.501331 62197 instancegroups.go:431] Draining the node: "node-1d.local". I0127 16:42:16.501366 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:16.502562 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:16.502798 62197 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0127 16:42:16.502845 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.503975 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.504008 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.504042 62197 instancegroups.go:431] Draining the node: "node-1e.local". I0127 16:42:16.504717 62197 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0127 16:42:16.504760 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.505895 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.505951 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.606345 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.606413 62197 instancegroups.go:431] Draining the node: "node-1f.local". I0127 16:42:16.607291 62197 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0127 16:42:16.607345 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.608474 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.608510 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.608524 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0127 16:42:16.608709 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.608731 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.608740 62197 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0127 16:42:16.609743 62197 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0127 16:42:16.609776 62197 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0127 16:42:16.609804 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.610919 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.610950 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.610990 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:16.611032 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:16.611952 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:16.612176 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:16.612212 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.613359 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.613404 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.713816 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.713891 62197 instancegroups.go:431] Draining the node: "node-1d.local". I0127 16:42:16.714740 62197 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0127 16:42:16.714790 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:16.715416 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:16.715454 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.716573 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.716607 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.716635 62197 instancegroups.go:431] Draining the node: "node-1e.local". I0127 16:42:16.717339 62197 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0127 16:42:16.717382 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.718481 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.718525 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.819023 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.819091 62197 instancegroups.go:431] Draining the node: "node-1f.local". I0127 16:42:16.819798 62197 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0127 16:42:16.819841 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.820989 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.821017 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.821031 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0127 16:42:16.821194 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.821209 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.821220 62197 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0127 16:42:16.821649 62197 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0127 16:42:16.821669 62197 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0127 16:42:16.821694 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.822823 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.822842 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:16.828001 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.828042 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:16.828050 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:16.828572 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:16.828596 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.828975 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:16.828999 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.829721 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.829741 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:16.835001 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.835040 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0127 16:42:16.835243 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.835259 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.835267 62197 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0127 16:42:16.835799 62197 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0127 16:42:16.835853 62197 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0127 16:42:16.835863 62197 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0127 16:42:16.835886 62197 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0127 16:42:16.835905 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.837043 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.837063 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:16.842253 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.842312 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:16.842356 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:16.843033 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:16.843059 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.843446 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:16.843468 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.844179 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.844205 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:16.849425 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.849453 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0127 16:42:16.849641 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.849663 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.849672 62197 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0127 16:42:16.850504 62197 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0127 16:42:16.850545 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.851657 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.851682 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.851690 62197 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0127 16:42:16.851721 62197 instancegroups.go:203] waiting for 1ms after detaching instance I0127 16:42:16.852851 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.852874 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.852902 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:16.852948 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:16.852964 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:16.853473 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:16.853506 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.853839 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:16.853864 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.854185 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:16.854209 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.854647 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.955286 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.955353 62197 instancegroups.go:431] Draining the node: "node-1d.local". I0127 16:42:16.955958 62197 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0127 16:42:16.955994 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.957130 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.957157 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.957172 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0127 16:42:16.957328 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.957347 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.957356 62197 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0127 16:42:16.958463 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:16.958869 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:16.958895 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.960032 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.960057 62197 instancegroups.go:540] Cluster validated. I0127 16:42:16.960079 62197 instancegroups.go:431] Draining the node: "node-1e.local". I0127 16:42:16.960137 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:16.960531 62197 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0127 16:42:16.960908 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:16.960933 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:16.962075 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:16.962111 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.062801 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.062858 62197 instancegroups.go:431] Draining the node: "node-1g.local". I0127 16:42:17.062890 62197 instancegroups.go:431] Draining the node: "node-1f.local". I0127 16:42:17.063909 62197 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0127 16:42:17.064176 62197 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0127 16:42:17.064220 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.065349 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.065392 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.065428 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:17.065916 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:17.065952 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.067074 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.067120 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.167740 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.167798 62197 instancegroups.go:431] Draining the node: "node-1d.local". I0127 16:42:17.168388 62197 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0127 16:42:17.168424 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.169548 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.169584 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.169608 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0127 16:42:17.169846 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.169881 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.169899 62197 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0127 16:42:17.169919 62197 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0127 16:42:17.169939 62197 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0127 16:42:17.169974 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0127 16:42:17.170126 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.170148 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.170162 62197 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0127 16:42:17.171084 62197 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0127 16:42:17.171109 62197 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0127 16:42:17.171127 62197 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0127 16:42:17.171164 62197 instancegroups.go:431] Draining the node: "node-1a.local". I0127 16:42:17.171862 62197 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0127 16:42:17.171893 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.173029 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.173048 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:17.178240 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.178286 62197 instancegroups.go:431] Draining the node: "node-1b.local". I0127 16:42:17.179099 62197 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0127 16:42:17.179132 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.180399 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.180419 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:17.185642 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.185680 62197 instancegroups.go:431] Draining the node: "node-1c.local". I0127 16:42:17.186438 62197 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0127 16:42:17.186469 62197 instancegroups.go:469] waiting for 1ms after terminating instance I0127 16:42:17.187622 62197 instancegroups.go:504] Validating the cluster. I0127 16:42:17.187641 62197 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0127 16:42:17.192826 62197 instancegroups.go:540] Cluster validated. I0127 16:42:17.192854 62197 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.984s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.004s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) PASS ok k8s.io/kops/pkg/k8scodecs 0.015s === RUN TestParse E0127 16:42:15.222878 62200 versions.go:96] unable to parse Kubernetes version "" E0127 16:42:15.222992 62200 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.009s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.042s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.13s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.207s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.02s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.103s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.072s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.093s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0127 16:42:15.281848 62206 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.072s === RUN Test_RunEtcdManagerBuilder I0127 16:42:15.290014 62208 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0127 16:42:15.348141 62208 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0127 16:42:15.350973 62208 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.07s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.148s === RUN Test_RunKubeApiserverBuilder I0127 16:42:15.287157 62209 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.092s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.093s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.028s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.065s === RUN TestServerGroupBuilder I0127 16:42:23.404424 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.419271 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.429286 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.449001 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.509438 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.527572 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.544886 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.559377 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.577775 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.658033 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.669780 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.682771 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.690683 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.701472 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.709529 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.718428 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.724855 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.736109 63135 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.38s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.496s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.040s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.039s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.027s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (2.18s) --- PASS: TestIssueCert/ca (0.57s) --- PASS: TestIssueCert/client (1.28s) --- PASS: TestIssueCert/clientOneYear (0.34s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 2.196s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s === RUN TestAddUntaggedRouteTables I0127 16:42:23.360574 63143 routetable.go:53] DescribeRouteTables: { } W0127 16:42:23.360696 63143 tags.go:67] cluster tag not found on route-table:rtb-1234 I0127 16:42:23.360710 63143 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0127 16:42:23.360863 63143 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0127 16:42:23.360945 63143 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0127 16:42:23.361055 63143 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0127 16:42:23.361162 63143 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0127 16:42:23.361244 63143 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0127 16:42:23.361359 63143 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0127 16:42:23.361472 63143 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0127 16:42:23.361513 63143 volumes.go:128] DescribeVolumes: { } W0127 16:42:23.361549 63143 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0127 16:42:23.361712 63143 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:23.361812 63143 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:23.361859 63143 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:23.361937 63143 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:23.361977 63143 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:23.362045 63143 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:23.362094 63143 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:23.362122 63143 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:23.362160 63143 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:23.362198 63143 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:23.362226 63143 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0127 16:42:23.362259 63143 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0127 16:42:23.362288 63143 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0127 16:42:23.362332 63143 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0127 16:42:23.362363 63143 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0127 16:42:23.362406 63143 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0127 16:42:23.362451 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0127 16:42:23.362484 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0127 16:42:23.362515 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0127 16:42:23.362544 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0127 16:42:23.362577 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0127 16:42:23.362607 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0127 16:42:23.362639 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0127 16:42:23.362664 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0127 16:42:23.362697 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0127 16:42:23.362725 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0127 16:42:23.362760 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0127 16:42:23.362787 63143 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.065s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.040s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.067s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.046s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.090s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.004s === RUN TestRemovesDuplicateGuardedBlocks W0127 16:42:30.946749 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946840 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946852 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946863 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946874 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946884 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946893 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946903 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946912 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946921 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946931 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946942 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946952 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946963 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.946971 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.946981 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.966571 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.966623 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.966709 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.966726 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.966797 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.966814 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.966890 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.966903 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.966976 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.966992 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967083 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967104 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967186 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967201 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967277 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967293 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967389 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967407 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967480 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967495 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967561 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967576 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967662 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967678 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967783 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967800 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967883 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967900 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.967972 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.967988 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968061 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968078 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968173 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968189 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968261 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968277 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968357 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968390 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968526 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968542 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968616 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968631 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968716 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968738 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968812 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968828 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.968945 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.968962 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969050 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969066 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969150 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969166 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969256 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969271 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969341 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969355 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969428 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969443 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969514 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969529 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969600 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969615 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969679 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969694 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969804 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969821 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969904 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.969921 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.969998 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970022 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970096 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970115 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970192 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970208 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970283 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970301 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970375 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970396 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970470 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970486 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970591 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970608 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970678 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970694 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970786 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970803 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970899 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.970916 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.970990 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971007 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971085 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971099 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971181 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971196 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971265 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971280 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971357 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971376 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971438 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971452 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971514 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971529 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971607 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971627 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971691 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971705 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971774 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971794 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971857 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971871 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.971942 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.971956 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972021 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972036 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972096 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972112 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972188 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972204 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972274 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972289 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972375 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972390 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972456 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972471 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972561 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972576 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972648 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972664 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972762 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972771 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972813 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972820 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972873 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972881 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972923 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.972931 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.972993 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973002 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973064 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973075 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973115 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973122 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973167 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973177 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973264 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973294 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973369 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973384 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973455 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973469 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973544 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973558 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973629 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973643 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973725 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973738 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973784 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973794 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973838 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973847 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973898 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973907 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.973969 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.973979 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974018 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974030 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974091 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974100 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974154 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974163 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974211 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974224 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974263 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974272 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974314 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974323 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974366 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974374 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974418 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974427 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974491 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974501 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974544 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974553 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974624 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974634 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974690 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974760 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974840 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974872 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.974936 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.974963 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.975034 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975065 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.975150 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975179 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.975251 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975279 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.03s) === RUN TestRecoversFromBadNesting W0127 16:42:30.975671 64420 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0127 16:42:30.975701 64420 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0127 16:42:30.975720 64420 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0127 16:42:30.975739 64420 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0127 16:42:30.975757 64420 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0127 16:42:30.975775 64420 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0127 16:42:30.975795 64420 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0127 16:42:30.975832 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975854 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975873 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.975894 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975912 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.975931 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975949 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.975967 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.975988 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.976014 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.976035 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.976062 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.976083 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.976102 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.976108 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.976114 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.978408 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.978429 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.978516 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.978539 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.978613 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.978628 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.978715 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.978733 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.978842 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.978857 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.978926 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.978941 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979016 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979031 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979104 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979119 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979191 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979205 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979275 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979288 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979365 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979380 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979447 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979460 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979558 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979573 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979643 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979657 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979727 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979741 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979807 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979826 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979919 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.979934 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.979999 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980013 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980086 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980100 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980175 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980189 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980262 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980276 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980346 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980360 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980427 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980441 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980510 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980524 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980610 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980627 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980705 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980720 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980794 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980809 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980875 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.980889 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.980997 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981016 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981109 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981127 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981190 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981202 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981289 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981301 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981366 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981377 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981436 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981447 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981510 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981522 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981584 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981596 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981669 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981681 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981744 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981766 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981831 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981843 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981906 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.981920 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.981982 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982004 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982068 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982082 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982161 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982176 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982236 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982249 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982324 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982338 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982398 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982412 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982479 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982492 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982562 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982576 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982646 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982659 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982720 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982740 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.982804 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.982818 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983182 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983205 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983309 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983323 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983387 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983401 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983471 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983485 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983562 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983575 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983646 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983661 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983730 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983745 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983808 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983823 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983887 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.983902 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.983988 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984003 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984073 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984088 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984154 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984169 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984242 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984257 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984330 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984344 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984418 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984432 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984504 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984519 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984596 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984611 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984695 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984711 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984780 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984796 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984872 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984886 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.984965 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.984981 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985053 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985069 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985163 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985178 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985247 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985260 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985334 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985351 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985467 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985485 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985556 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985572 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985638 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985653 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985715 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985742 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985811 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985827 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985903 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.985918 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.985997 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986012 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986085 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986100 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986176 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986190 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986253 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986269 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986332 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986346 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986420 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986436 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986517 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986540 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986618 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986636 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986712 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986730 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986803 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986818 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986900 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986918 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.986982 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.986997 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.987069 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.987083 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.987151 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.987169 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.987236 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.987249 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.987314 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.987327 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0127 16:42:30.987401 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0127 16:42:30.987414 64420 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.01s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.046s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.034s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.070s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.02s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.02s) PASS ok k8s.io/kops/tests/integration/conversion 0.053s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0127 16:42:30.977230 64423 files.go:57] Writing file "/tmp/TestWriteFile3811688480/001/SubDir/test1.tmp" I0127 16:42:30.977353 64423 files.go:113] Changing file mode for "/tmp/TestWriteFile3811688480/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.043s === RUN TestBootstrapChannelBuilder_BuildTasks I0127 16:42:34.443282 65318 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:34.443454 65318 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:34.443488 65318 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:34.443526 65318 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:34.443553 65318 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:34.443601 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:34.443633 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:34.443649 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:34.443681 65318 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:34.443714 65318 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:34.451472 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:34.554723 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:34.706831 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:34.851993 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:34.968436 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:35.092615 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:35.207647 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:35.338211 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:35.903979 65318 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.56s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0127 16:42:36.005266 65318 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:36.005351 65318 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:36.005412 65318 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:36.005449 65318 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:36.005475 65318 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:36.005508 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:36.005534 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:36.005550 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:36.005579 65318 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:36.005599 65318 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:36.005618 65318 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0127 16:42:36.006781 65318 zones.go:93] ListHostedZonesPages { } I0127 16:42:36.148223 65318 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.14s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0127 16:42:36.148367 65318 featureflag.go:164] FeatureFlag "ImageDigest"=false I0127 16:42:36.148446 65318 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:36.148497 65318 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0127 16:42:36.148534 65318 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0127 16:42:36.148562 65318 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0127 16:42:36.148618 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0127 16:42:36.148654 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0127 16:42:36.148675 65318 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0127 16:42:36.148701 65318 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0127 16:42:36.148722 65318 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0127 16:42:36.149948 65318 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.14s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.14s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0127 16:42:36.447141 65318 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0127 16:42:36.481142 65318 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0127 16:42:36.481209 65318 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0127 16:42:36.481226 65318 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0127 16:42:36.481283 65318 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0127 16:42:36.481300 65318 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0127 16:42:36.481357 65318 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0127 16:42:36.481416 65318 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0127 16:42:36.481475 65318 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0127 16:42:36.481491 65318 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0127 16:42:36.481548 65318 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0127 16:42:36.481564 65318 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0127 16:42:36.481652 65318 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0127 16:42:36.481739 65318 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0127 16:42:36.481800 65318 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0127 16:42:36.481815 65318 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0127 16:42:36.481828 65318 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0127 16:42:36.481845 65318 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0127 16:42:36.481859 65318 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0127 16:42:36.481872 65318 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0127 16:42:36.481886 65318 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0127 16:42:36.481899 65318 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0127 16:42:36.483372 65318 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0127 16:42:36.483565 65318 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.123s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0127 16:42:34.674817 65346 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4169739119/001 I0127 16:42:34.675173 65346 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4169739119/001 I0127 16:42:34.675402 65346 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4169739119/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0127 16:42:34.679707 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0127 16:42:34.679791 65346 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0127 16:42:34.679855 65346 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0127 16:42:34.679999 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.680111 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.680172 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.680189 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.680391 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.680435 65346 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0127 16:42:34.680469 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.680539 65346 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0127 16:42:34.680633 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0127 16:42:34.680684 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.680734 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.680775 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.680791 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.680822 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.680863 65346 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0127 16:42:34.680918 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0127 16:42:34.681054 65346 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0127 16:42:34.681110 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.681202 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0127 16:42:34.681238 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.681261 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.681284 65346 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0127 16:42:34.681341 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.681498 65346 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0127 16:42:34.681549 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.681572 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.681595 65346 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0127 16:42:34.681650 65346 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.681800 65346 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0127 16:42:34.681845 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.681866 65346 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" },{ Key: "AssociatedElasticIp", Value: "192.0.2.1" }] } I0127 16:42:34.681899 65346 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0127 16:42:34.681968 65346 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0127 16:42:34.682011 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.682051 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.682066 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.682089 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.682109 65346 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0127 16:42:34.682141 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.682191 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.682214 65346 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0127 16:42:34.682246 65346 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.682291 65346 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0127 16:42:34.682333 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0127 16:42:34.682367 65346 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0127 16:42:34.682424 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0127 16:42:34.682464 65346 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0127 16:42:34.682485 65346 internetgateways.go:66] CreateInternetGateway: { } I0127 16:42:34.682506 65346 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0127 16:42:34.682550 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.682587 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.682621 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.682635 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.682701 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.682725 65346 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0127 16:42:34.682753 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.682802 65346 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0127 16:42:34.682859 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0127 16:42:34.682904 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.682937 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.682972 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.682987 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.683015 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.683047 65346 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0127 16:42:34.683098 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0127 16:42:34.683465 65346 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender278141985/001 I0127 16:42:34.683682 65346 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender278141985/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0127 16:42:34.684012 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.684053 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.684133 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0127 16:42:34.684174 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.684195 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.684217 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.684276 65346 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0127 16:42:34.684461 65346 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0127 16:42:34.684512 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0127 16:42:34.684542 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0127 16:42:34.684594 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.684632 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.684673 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.684688 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.684711 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.684733 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.684781 65346 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0127 16:42:34.684859 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0127 16:42:34.685060 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.685097 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.685183 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0127 16:42:34.685220 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.685241 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.685263 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.685299 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.685379 65346 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0127 16:42:34.685414 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.685433 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.685454 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0127 16:42:34.685507 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.685546 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.685593 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.685608 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.685631 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.685652 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.685685 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.685734 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.685756 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0127 16:42:34.685866 65346 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0127 16:42:34.685904 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.685977 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0127 16:42:34.686010 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.686031 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.686052 65346 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0127 16:42:34.686088 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.686175 65346 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0127 16:42:34.686187 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.686333 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.686369 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.686395 65346 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:42:34.686434 65346 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0127 16:42:34.686499 65346 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0127 16:42:34.686548 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.686588 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.686603 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.686631 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.686653 65346 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0127 16:42:34.686686 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.686739 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.686758 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.686796 65346 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0127 16:42:34.686886 65346 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0127 16:42:34.686922 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.686991 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0127 16:42:34.687023 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.687043 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.687064 65346 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0127 16:42:34.687097 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.687208 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.687247 65346 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0127 16:42:34.687289 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.687325 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.687349 65346 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0127 16:42:34.687375 65346 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0127 16:42:34.687432 65346 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0127 16:42:34.687469 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.687508 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.687522 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.687545 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.687567 65346 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0127 16:42:34.687598 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.687640 65346 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0127 16:42:34.687719 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.687744 65346 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0127 16:42:34.687792 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0127 16:42:34.687844 65346 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0127 16:42:34.687913 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.687953 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.687991 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.688006 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.688073 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.688104 65346 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0127 16:42:34.688133 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.688163 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.688256 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0127 16:42:34.688280 65346 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0127 16:42:34.688307 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0127 16:42:34.688370 65346 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0127 16:42:34.688407 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.688441 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.688456 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.688483 65346 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0127 16:42:34.688513 65346 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0127 16:42:34.688560 65346 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0127 16:42:34.688646 65346 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:34.688681 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.688783 65346 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0127 16:42:34.688816 65346 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0127 16:42:34.688836 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.688857 65346 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:34.688888 65346 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:34.688928 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0127 16:42:34.688965 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.688980 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.689001 65346 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0127 16:42:34.689021 65346 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0127 16:42:34.689115 65346 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0127 16:42:34.689170 65346 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:34.689204 65346 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0127 16:42:34.689245 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0127 16:42:34.689260 65346 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0127 16:42:34.689288 65346 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.078s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.091s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.060s === RUN TestDiskRenderAzure I0127 16:42:37.152615 65531 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0127 16:42:37.153047 65531 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0127 16:42:37.153386 65531 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0127 16:42:37.154422 65531 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0127 16:42:37.154843 65531 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0127 16:42:37.155234 65531 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0127 16:42:37.155616 65531 resourcegroup.go:108] Creating a new Resource Group with name: rg I0127 16:42:37.155637 65531 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0127 16:42:37.155954 65531 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0127 16:42:37.156855 65531 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0127 16:42:37.157232 65531 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0127 16:42:37.161299 65531 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0127 16:42:37.161974 65531 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0127 16:42:37.162354 65531 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.056s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.052s === RUN TestProjectIAMBinding I0127 16:42:37.216788 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.217407 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:37.217436 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.217924 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:37.217971 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.218146 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0127 16:42:37.218292 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.218419 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:37.218458 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.218601 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:37.218637 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.218716 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0127 16:42:37.218846 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.219257 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:37.219293 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.219839 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0127 16:42:37.219894 65533 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0127 16:42:37.220089 65533 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.116s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.03s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.096s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.093s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.01s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.049s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.053s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.007s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.052s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0127 16:42:39.217042 1291 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0127 16:42:39.217132 1291 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0127 16:42:39.217143 1291 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0127 16:42:39.217159 1291 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0127 16:42:39.217170 1291 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0127 16:42:39.217180 1291 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0127 16:42:39.217191 1291 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0127 16:42:39.217650 1291 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.065s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.004s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.004s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.003s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.004s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.004s === RUN TestGetProxyEnvVars W0127 16:42:39.179051 1297 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.023s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.028s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.004s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.026s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0127 16:42:43.199792 1405 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.060s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 145.5 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.3-r0.apk >>> kops: Build complete at Sat, 27 Jan 2024 16:45:29 +0000 elapsed time 0h 6m 34s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20240127.163856) (2/5) Purging kubernetes (1.29.0-r0) (3/5) Purging go (1.21.6-r0) (4/5) Purging bash (5.2.26-r0) Executing bash-5.2.26-r0.pre-deinstall (5/5) Purging readline (8.2.10-r0) Executing busybox-1.36.1-r19.trigger OK: 378 MiB in 107 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...