>>> kops: Building testing/kops 1.28.2-r0 (using abuild 3.12.0-r0) started Thu, 28 Dec 2023 04:17:33 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.29.0-r0) (2/5) Installing go (1.21.5-r0) (3/5) Installing readline (8.2.7-r0) (4/5) Installing bash (5.2.21-r0) Executing bash-5.2.21-r0.post-install (5/5) Installing .makedepends-kops (20231228.041735) Executing busybox-1.36.1-r18.trigger OK: 555 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.2.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 146 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (22) The requested URL returned error: 404 >>> kops: Fetching kops-1.28.2.tar.gz::https://github.com/kubernetes/kops/archive/v1.28.2.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7696k 0 7696k 0 0 7582k 0 --:--:-- 0:00:01 --:--:-- 7582k 100 14.4M 0 14.4M 0 0 7308k 0 --:--:-- 0:00:02 --:--:-- 7034k 100 21.0M 0 21.0M 0 0 7147k 0 --:--:-- 0:00:03 --:--:-- 6923k 100 26.5M 0 26.5M 0 0 6767k 0 --:--:-- 0:00:04 --:--:-- 6493k 100 32.4M 0 32.4M 0 0 6620k 0 --:--:-- 0:00:05 --:--:-- 6377k 100 32.6M 0 32.6M 0 0 6596k 0 --:--:-- 0:00:05 --:--:-- 6350k >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.2.tar.gz >>> kops: Checking sha512sums... kops-1.28.2.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.2.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.2/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.2/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.2 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading k8s.io/apimachinery v0.28.1 go: downloading github.com/aws/aws-sdk-go v1.45.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/spf13/viper v1.16.0 go: downloading k8s.io/api v0.28.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading k8s.io/client-go v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading k8s.io/klog v1.0.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/sys v0.13.0 go: downloading golang.org/x/term v0.13.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading k8s.io/component-helpers v0.28.1 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/containerd/containerd v1.7.5 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/moby/locker v1.0.1 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I1228 04:20:16.228274 43285 addon.go:250] addon test wants to update all nodes I1228 04:20:16.230525 43285 addon.go:250] addon test wants to update workers nodes I1228 04:20:16.230963 43285 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I1228 04:20:16.231574 43285 addon.go:283] installing PKI for "test" I1228 04:20:16.541454 43285 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.71s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.799s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.069s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I1228 04:20:18.296826 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.297025 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.297064 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.297114 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.297149 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.297216 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.297263 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.297280 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.297322 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.297350 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.302521 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.302580 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.335271 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.335476 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.335847 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:18.350635 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.350712 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.350738 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.350768 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.350792 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.350821 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.350846 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.350864 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.350888 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.350906 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.354314 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.354357 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.474291 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.474452 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.474724 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:18.481743 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.481819 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.481851 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.481881 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.481907 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.481948 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.481980 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.481997 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.482020 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.482045 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.485565 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.485603 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.537319 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.537489 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.537773 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:18.543069 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.543135 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.543161 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.543190 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.543212 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.543240 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.543265 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.543283 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.543307 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.543324 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.575128 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.575187 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.615715 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.615904 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.616196 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:18.621731 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.621805 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.621834 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.621860 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.621888 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.621926 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.621958 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.621975 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.621998 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.622020 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.625621 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.625661 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.705048 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.705212 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.705531 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:18.710671 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.710741 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.710775 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.710806 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.710829 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.710857 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.710885 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.710902 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.710925 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.710941 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.714732 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.714778 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.771499 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.771631 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.772033 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:18.781284 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.781380 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.781414 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.781454 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.781495 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.781540 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.781580 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.781612 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.781651 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.781678 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.785636 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.785688 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.848608 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:18.848915 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:18.849403 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.56s) === RUN TestCreateClusterHetzner I1228 04:20:18.860072 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.860210 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.860245 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.860283 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.860309 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.860344 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.860374 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.860392 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.860417 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.860438 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.864269 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.864321 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1228 04:20:18.882795 44881 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1228 04:20:18.882839 44881 new_cluster.go:1373] Cloud Provider ID: "hetzner" I1228 04:20:18.929828 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.929964 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.930008 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.930046 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.930070 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.930112 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.930142 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.930160 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.930201 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.930222 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:18.964017 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.964073 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:18.993990 44881 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.14s) === RUN TestCreateClusterOpenStack I1228 04:20:18.999307 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:18.999395 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:18.999421 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:18.999458 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:18.999482 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:18.999513 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:18.999546 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:18.999566 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:18.999593 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:18.999616 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.003120 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.003169 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1228 04:20:19.080119 44881 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1228 04:20:19.080167 44881 new_cluster.go:1373] Cloud Provider ID: "openstack" I1228 04:20:19.082866 44881 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.09s) === RUN TestCreateClusterOpenStackOctavia I1228 04:20:19.093209 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.093296 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.093323 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.093352 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.093378 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.093409 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.093434 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.093450 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.093473 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.093490 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.097227 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.097279 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1228 04:20:19.138846 44881 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1228 04:20:19.138891 44881 new_cluster.go:1373] Cloud Provider ID: "openstack" I1228 04:20:19.141486 44881 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1228 04:20:19.141510 44881 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.06s) === RUN TestCreateClusterOpenStackNoDNS I1228 04:20:19.149527 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.149620 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.149650 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.149683 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.149709 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.149744 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.149771 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.149788 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.149811 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.149830 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.153299 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.153344 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1228 04:20:19.190495 44881 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1228 04:20:19.190538 44881 new_cluster.go:1373] Cloud Provider ID: "openstack" I1228 04:20:19.190587 44881 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1228 04:20:19.190604 44881 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.05s) === RUN TestCreateClusterCilium I1228 04:20:19.198300 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.198385 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.198412 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.198438 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.198464 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.198494 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.198519 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.198537 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.198562 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.198579 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.202386 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.202424 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.227206 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.227723 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:19.228822 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.04s) === RUN TestCreateClusterOverride I1228 04:20:19.234733 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.234835 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.234861 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.234894 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.234918 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.234947 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.234971 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.234990 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.235012 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.235028 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.238656 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.238695 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.299700 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.300236 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:19.300557 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.07s) === RUN TestCreateClusterKubernetesFeatureGates I1228 04:20:19.306085 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.306165 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.306191 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.306218 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.306242 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.306271 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.306296 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.306314 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.306336 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.306352 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.310010 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.310067 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.343788 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.343984 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:19.344420 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.05s) === RUN TestCreateClusterComplex I1228 04:20:19.351281 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.351399 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.351438 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.351473 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.351499 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.351532 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.351561 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.351580 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.351604 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.351623 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.355260 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.355306 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.392800 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.393154 44881 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I1228 04:20:19.393175 44881 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I1228 04:20:19.393189 44881 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I1228 04:20:19.393623 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.05s) === RUN TestCreateClusterComplexPrivate I1228 04:20:19.403396 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.403492 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.403866 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.403901 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.403926 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.403959 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.403987 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.404006 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.404035 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.404054 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.407896 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.407947 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.435322 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.435718 44881 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I1228 04:20:19.435739 44881 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I1228 04:20:19.435753 44881 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I1228 04:20:19.435766 44881 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I1228 04:20:19.435779 44881 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I1228 04:20:19.435792 44881 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I1228 04:20:19.435804 44881 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I1228 04:20:19.435819 44881 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I1228 04:20:19.435832 44881 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I1228 04:20:19.435846 44881 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I1228 04:20:19.436343 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.05s) === RUN TestCreateClusterHA I1228 04:20:19.448805 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.448889 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.448916 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.448945 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.448972 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.449005 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.449031 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.449051 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.449076 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.449095 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.493390 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.493440 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.535790 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.536124 44881 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1228 04:20:19.536144 44881 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1228 04:20:19.536158 44881 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1228 04:20:19.536536 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:19.547627 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.547723 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.547753 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.547787 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.547813 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.547849 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.547878 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.547897 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.547920 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.547939 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.551729 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.551771 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.571330 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.571678 44881 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1228 04:20:19.571698 44881 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1228 04:20:19.571712 44881 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1228 04:20:19.572092 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.13s) === RUN TestCreateClusterMinimalGCE I1228 04:20:19.581143 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.581233 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.581262 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.581294 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.581320 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.581378 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.581410 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.581429 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.581453 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.581471 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.585129 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.585165 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.613553 44881 new_cluster.go:1373] Cloud Provider ID: "gce" I1228 04:20:19.613723 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I1228 04:20:19.619768 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.619857 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.619889 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.619921 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.619946 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.619986 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.620014 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.620040 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.620068 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.620087 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.624407 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.624475 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.667389 44881 new_cluster.go:1373] Cloud Provider ID: "gce" I1228 04:20:19.667489 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.09s) === RUN TestCreateClusterHAGCE I1228 04:20:19.673541 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.673645 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.673670 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.673698 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.673721 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.673753 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.673779 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.673796 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.673818 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.673836 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.677381 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.677437 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.721014 44881 new_cluster.go:1373] Cloud Provider ID: "gce" I1228 04:20:19.721148 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.06s) === RUN TestCreateClusterGCE I1228 04:20:19.729497 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.729576 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.729600 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.729629 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.729655 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.729684 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.729709 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.729726 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.729750 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.729768 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.733819 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.733864 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.767125 44881 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1228 04:20:19.767204 44881 new_cluster.go:1373] Cloud Provider ID: "gce" I1228 04:20:19.767279 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.04s) === RUN TestCreateClusterHASharedZone I1228 04:20:19.772806 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.772882 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.772908 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.772935 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.772958 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.772988 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.773015 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.773033 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.773058 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.773075 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.776712 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.776751 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1228 04:20:19.866515 44881 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1228 04:20:19.866559 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.866788 44881 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1228 04:20:19.867129 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.10s) === RUN TestCreateClusterHASharedZones I1228 04:20:19.874345 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.874426 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.874451 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.874484 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.874509 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.874537 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.874561 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.874580 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.874603 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.874619 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.879667 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.879750 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1228 04:20:19.910602 44881 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1228 04:20:19.910650 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.910997 44881 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I1228 04:20:19.911015 44881 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I1228 04:20:19.911373 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.05s) === RUN TestCreateClusterPrivate I1228 04:20:19.921203 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.921284 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.921307 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.921335 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.921361 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.921389 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.921414 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.921432 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.921456 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.921473 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.925593 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.925636 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.962998 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:19.963225 44881 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1228 04:20:19.963244 44881 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1228 04:20:19.963615 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:19.963647 44881 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.05s) === RUN TestCreateClusterPrivateGCE I1228 04:20:19.970585 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:19.970675 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:19.970701 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:19.970728 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:19.970750 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:19.970780 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:19.970806 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:19.970822 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:19.970844 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:19.970861 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:19.974982 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:19.975025 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.099807 44881 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1228 04:20:20.099890 44881 new_cluster.go:1373] Cloud Provider ID: "gce" I1228 04:20:20.099987 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.14s) === RUN TestCreateClusterWithNGWSpecified I1228 04:20:20.111228 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.111358 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.111397 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.111446 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.111487 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.111537 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.111579 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.111611 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.111653 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.111685 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.115821 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.115861 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.142247 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.142443 44881 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1228 04:20:20.142462 44881 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1228 04:20:20.142784 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:20.142815 44881 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.04s) === RUN TestCreateClusterWithINGWSpecified I1228 04:20:20.150568 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.150670 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.150696 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.150723 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.150755 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.150786 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.150816 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.150845 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.150871 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.150888 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.155122 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.155180 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.322873 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.323114 44881 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1228 04:20:20.323134 44881 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1228 04:20:20.323539 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:20.323583 44881 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.18s) === RUN TestCreateClusterSharedVPC I1228 04:20:20.330511 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.330617 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.330649 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.330687 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.330712 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.330746 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.330775 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.330793 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.330819 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.330837 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.335660 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.335742 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.385878 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.386039 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.386101 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.386137 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.386154 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.386198 44881 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I1228 04:20:20.386526 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.06s) === RUN TestCreateClusterSharedSubnets I1228 04:20:20.394562 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.394649 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.394675 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.394704 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.394731 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.394763 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.394790 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.394806 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.394829 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.394846 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.398759 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.398799 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.438173 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.438217 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.438301 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.438437 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.438459 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.438482 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.438499 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.438827 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.05s) === RUN TestCreateClusterSharedSubnetsVpcLookup I1228 04:20:20.444852 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.444932 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.444959 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.444984 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.445007 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.445037 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.445063 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.445080 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.445103 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.445122 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.448968 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.449023 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.499060 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:20:20.499118 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.499141 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.499225 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.499367 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.499387 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.499409 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.499423 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.499807 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.06s) === RUN TestCreateClusterPrivateSharedSubnets I1228 04:20:20.508444 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.508579 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.508621 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.508674 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.508718 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.508770 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.508814 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.508843 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.508881 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.508913 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.513397 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.513453 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.562509 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.562561 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.562618 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.562634 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.562696 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.562841 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.562861 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.562882 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:20:20.562897 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:20:20.563292 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.06s) === RUN TestCreateClusterIPv6 I1228 04:20:20.573313 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.573467 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.573534 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.573593 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.573641 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.573703 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.573761 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.573803 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.573850 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.573888 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.578576 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.578637 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.614101 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.614594 44881 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I1228 04:20:20.614643 44881 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I1228 04:20:20.615562 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.05s) === RUN TestCreateClusterDifferentAMIs I1228 04:20:20.623633 44881 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1228 04:20:20.623651 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.623730 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.623757 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.623791 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.623816 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.623845 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.623872 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.623889 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.623913 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.623931 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.627916 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.627956 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.665083 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.665168 44881 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1228 04:20:20.665186 44881 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1228 04:20:20.665515 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:20.672429 44881 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.05s) === RUN TestCreateClusterKarpenter I1228 04:20:20.672525 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.672604 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.672629 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.672656 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.672681 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.672711 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.672737 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.672756 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.672781 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.672798 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.676298 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.676341 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1228 04:20:20.709870 44881 new_cluster.go:1373] Cloud Provider ID: "aws" I1228 04:20:20.710046 44881 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1228 04:20:20.710066 44881 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1228 04:20:20.710079 44881 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1228 04:20:20.710437 44881 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.04s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I1228 04:20:20.716627 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.716690 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.716714 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.716777 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.716799 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.716830 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.716866 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.716884 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.716909 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.716927 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.722119 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I1228 04:20:20.723859 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:20.723964 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:20.723994 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:20.724030 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:20.724067 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:20.724108 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:20.724197 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:20.724230 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:20.724268 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:20.724294 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:20.738085 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1228 04:20:20.741042 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:20.741173 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1228 04:20:26.247980 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:29.656420 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:20:29.658066 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:29.658110 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:29.658259 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:29.662001 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:20:29.672371 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:20:29.674149 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:29.674386 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:29.674856 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:29.675046 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:29.675167 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:20:29.675761 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:20:29.676343 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:20:29.680077 44881 target.go:111] Terraform output is in /tmp/test1609245482/out --- PASS: TestMinimal (8.96s) === RUN TestMinimal_v1_23 I1228 04:20:29.684277 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:29.684492 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:29.684573 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:29.684666 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:29.684746 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:29.684867 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:29.684993 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:29.685069 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:29.685149 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:29.685223 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:29.711660 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1228 04:20:29.714772 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:29.714890 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:32.702754 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:32.885899 44881 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1228 04:20:32.896965 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:32.897084 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:32.897198 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:32.899808 44881 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1228 04:20:32.903488 44881 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1228 04:20:32.904176 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:32.904624 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:32.904971 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:32.905347 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:32.905442 44881 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1228 04:20:32.905691 44881 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1228 04:20:32.905981 44881 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1228 04:20:32.911538 44881 target.go:111] Terraform output is in /tmp/test1616543173/out --- PASS: TestMinimal_v1_23 (3.23s) === RUN TestMinimal_v1_24 I1228 04:20:32.916175 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:32.916317 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:32.916362 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:32.916415 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:32.916460 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:32.916514 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:32.916605 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:32.916642 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:32.916685 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:32.916715 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:32.944319 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:20:32.948786 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:32.948919 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:35.563999 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:35.715761 44881 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1228 04:20:35.716201 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:35.716234 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:35.716331 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:35.718626 44881 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1228 04:20:35.725533 44881 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1228 04:20:35.725953 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:35.726068 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:35.726440 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:35.726495 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:35.726553 44881 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1228 04:20:35.726759 44881 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1228 04:20:35.726969 44881 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1228 04:20:35.731761 44881 target.go:111] Terraform output is in /tmp/test346465957/out --- PASS: TestMinimal_v1_24 (2.82s) === RUN TestMinimal_v1_25 I1228 04:20:35.735587 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:35.735699 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:35.735735 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:35.735777 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:35.735813 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:35.735863 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:35.735951 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:35.735982 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:35.736021 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:35.736048 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:35.763942 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:20:35.766978 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:35.767109 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:38.144761 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:38.259596 44881 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1228 04:20:38.260126 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:38.260147 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:38.260223 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:38.267975 44881 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1228 04:20:38.271553 44881 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1228 04:20:38.271713 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:38.271848 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:38.272153 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:38.272256 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:38.272317 44881 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1228 04:20:38.272491 44881 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1228 04:20:38.272680 44881 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1228 04:20:38.275944 44881 target.go:111] Terraform output is in /tmp/test60745891/out --- PASS: TestMinimal_v1_25 (2.54s) === RUN TestMinimal_v1_26 I1228 04:20:38.278692 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:38.279125 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:38.279158 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:38.279191 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:38.279219 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:38.279251 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:38.279307 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:38.279324 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:38.279348 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:38.279367 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:38.295286 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:20:38.297263 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:38.297328 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:40.824314 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:40.951550 44881 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1228 04:20:40.952200 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:40.952221 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:40.952283 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:40.955068 44881 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1228 04:20:40.960199 44881 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1228 04:20:40.960601 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:40.960803 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:40.961112 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:40.961249 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:40.961315 44881 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1228 04:20:40.961596 44881 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1228 04:20:40.961820 44881 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1228 04:20:40.967181 44881 target.go:111] Terraform output is in /tmp/test2129449333/out --- PASS: TestMinimal_v1_26 (2.69s) === RUN TestMinimal_v1_27 I1228 04:20:40.971252 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:40.971379 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:40.971423 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:40.971469 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:40.971508 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:40.971562 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:40.971645 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:40.971679 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:40.971720 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:40.971749 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:40.993159 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1228 04:20:40.995143 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:40.995206 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:43.847778 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:43.938749 44881 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1228 04:20:43.939258 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:43.939282 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:43.939356 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:43.941224 44881 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1228 04:20:43.944090 44881 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1228 04:20:43.944248 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:43.944402 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:43.944657 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:43.945293 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:43.945419 44881 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1228 04:20:43.945877 44881 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1228 04:20:43.947865 44881 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1228 04:20:43.950444 44881 target.go:111] Terraform output is in /tmp/test1636440534/out --- PASS: TestMinimal_v1_27 (2.98s) === RUN TestMinimal_NoneDNS I1228 04:20:43.952663 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:43.952735 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:43.952759 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:43.952785 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:43.952805 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:43.952831 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:43.952874 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:43.952897 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:43.952915 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:43.952930 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:20:43.966773 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:43.966841 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:45.347256 44881 executor.go:111] Tasks: 0 done / 110 total; 43 can run I1228 04:20:45.349904 44881 executor.go:111] Tasks: 43 done / 110 total; 24 can run I1228 04:20:45.351555 44881 executor.go:111] Tasks: 67 done / 110 total; 29 can run I1228 04:20:45.352067 44881 executor.go:111] Tasks: 96 done / 110 total; 2 can run I1228 04:20:45.352127 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:20:45.352179 44881 loadbalancers.go:35] PageSize not implemented I1228 04:20:45.352270 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:20:45.352320 44881 loadbalancers.go:35] PageSize not implemented I1228 04:20:45.355353 44881 executor.go:111] Tasks: 98 done / 110 total; 4 can run I1228 04:20:45.355479 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:45.355670 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:45.355902 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:45.355978 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:45.356050 44881 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1228 04:20:45.356231 44881 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1228 04:20:45.356413 44881 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1228 04:20:45.361486 44881 target.go:111] Terraform output is in /tmp/test1054399005/out --- PASS: TestMinimal_NoneDNS (1.41s) === RUN TestHetzner I1228 04:20:45.364945 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:20:47.285936 44881 executor.go:111] Tasks: 0 done / 46 total; 37 can run I1228 04:20:47.290733 44881 executor.go:111] Tasks: 37 done / 46 total; 3 can run I1228 04:20:47.291270 44881 executor.go:111] Tasks: 40 done / 46 total; 2 can run I1228 04:20:47.298338 44881 executor.go:111] Tasks: 42 done / 46 total; 4 can run I1228 04:20:47.299288 44881 executor.go:111] Tasks: 46 done / 46 total; 0 can run I1228 04:20:47.301598 44881 target.go:111] Terraform output is in /tmp/test2123621777/out --- PASS: TestHetzner (1.94s) === RUN TestNvidia I1228 04:20:47.304765 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:47.304930 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:47.304987 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:47.305069 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:47.305134 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:47.305222 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:47.305333 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:47.305393 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:47.305462 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:47.305509 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:47.330652 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:20:47.333967 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:47.334084 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:49.256735 44881 zones.go:93] ListHostedZonesPages { } I1228 04:20:49.396928 44881 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1228 04:20:49.397946 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:20:49.397987 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:20:49.398127 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:20:49.400296 44881 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1228 04:20:49.406334 44881 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1228 04:20:49.406680 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:49.406986 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:49.407185 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:49.407932 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:49.408052 44881 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1228 04:20:49.408327 44881 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1228 04:20:49.408629 44881 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1228 04:20:49.413815 44881 target.go:111] Terraform output is in /tmp/test4172585702/out --- PASS: TestNvidia (2.11s) === RUN TestMinimalGossip I1228 04:20:49.418263 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:49.418389 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:49.418429 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:49.418478 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:49.418520 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:49.418573 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:49.418655 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:49.418685 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:49.418722 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:49.418751 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:20:49.445798 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:49.445878 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:50.862622 44881 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1228 04:20:50.866420 44881 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1228 04:20:50.869216 44881 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1228 04:20:50.869425 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:50.869732 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:50.869954 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:50.870273 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:50.870417 44881 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1228 04:20:50.870668 44881 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1228 04:20:50.870982 44881 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1228 04:20:50.876303 44881 target.go:111] Terraform output is in /tmp/test1965674532/out --- PASS: TestMinimalGossip (1.46s) === RUN TestMinimalGossipIRSA I1228 04:20:50.883084 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:50.883235 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:50.883285 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:50.883387 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:50.883438 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:50.883495 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:50.883601 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:50.883632 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:50.883671 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:50.883708 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:20:50.912145 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:50.912228 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:52.615815 44881 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1228 04:20:52.618463 44881 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1228 04:20:52.623786 44881 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1228 04:20:52.624073 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:52.624231 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:52.624379 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:52.624557 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:20:52.624621 44881 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1228 04:20:52.624788 44881 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1228 04:20:52.624991 44881 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1228 04:20:52.630763 44881 target.go:111] Terraform output is in /tmp/test2640636406/out --- PASS: TestMinimalGossipIRSA (1.75s) === RUN TestMinimalGCE I1228 04:20:52.635668 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:52.637556 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:20:54.981521 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:20:54.981593 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:20:54.981697 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1228 04:20:54.981721 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1228 04:20:54.981742 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1228 04:20:54.981782 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:20:54.982752 44881 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1228 04:20:54.984721 44881 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1228 04:20:54.988202 44881 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1228 04:20:54.989002 44881 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1228 04:20:54.989214 44881 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1228 04:20:54.991193 44881 target.go:111] Terraform output is in /tmp/test199811454/out --- PASS: TestMinimalGCE (2.36s) === RUN TestMinimalGCEPrivate I1228 04:20:54.993179 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:54.994258 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:20:56.646400 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:20:56.646469 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:20:56.646553 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W1228 04:20:56.646574 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W1228 04:20:56.646588 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W1228 04:20:56.646627 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:20:56.647528 44881 executor.go:111] Tasks: 0 done / 65 total; 41 can run I1228 04:20:56.651045 44881 executor.go:111] Tasks: 41 done / 65 total; 17 can run I1228 04:20:56.654622 44881 executor.go:111] Tasks: 58 done / 65 total; 5 can run I1228 04:20:56.655601 44881 executor.go:111] Tasks: 63 done / 65 total; 2 can run I1228 04:20:56.655817 44881 executor.go:111] Tasks: 65 done / 65 total; 0 can run I1228 04:20:56.659406 44881 target.go:111] Terraform output is in /tmp/test1654781898/out --- PASS: TestMinimalGCEPrivate (1.67s) === RUN TestMinimalGCEInternalLoadBalancer I1228 04:20:56.662662 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:56.664450 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:20:58.429264 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:20:58.429321 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:20:58.429393 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W1228 04:20:58.429412 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W1228 04:20:58.429423 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W1228 04:20:58.429457 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1228 04:20:58.429484 44881 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1228 04:20:58.430335 44881 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1228 04:20:58.433753 44881 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1228 04:20:58.434152 44881 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1228 04:20:58.434557 44881 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1228 04:20:58.441347 44881 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1228 04:20:58.442343 44881 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1228 04:20:58.442537 44881 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1228 04:20:58.442821 44881 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1228 04:20:58.443114 44881 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1228 04:20:58.446525 44881 target.go:111] Terraform output is in /tmp/test121997681/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.79s) === RUN TestMinimalGCEPublicLoadBalancer I1228 04:20:58.449846 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.451628 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:21:00.341388 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:21:00.341496 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:21:00.341646 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W1228 04:21:00.341681 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W1228 04:21:00.341706 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W1228 04:21:00.341771 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:21:00.343535 44881 executor.go:111] Tasks: 0 done / 71 total; 43 can run I1228 04:21:00.352701 44881 executor.go:111] Tasks: 43 done / 71 total; 19 can run I1228 04:21:00.356527 44881 executor.go:111] Tasks: 62 done / 71 total; 7 can run I1228 04:21:00.357485 44881 executor.go:111] Tasks: 69 done / 71 total; 2 can run I1228 04:21:00.357637 44881 executor.go:111] Tasks: 71 done / 71 total; 0 can run I1228 04:21:00.360741 44881 target.go:111] Terraform output is in /tmp/test2430176219/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.91s) === RUN TestMinimalGCELongClusterName I1228 04:21:00.363571 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:00.364765 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:21:01.976939 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:21:01.977169 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:21:01.977367 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1228 04:21:01.977435 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1228 04:21:01.977489 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1228 04:21:01.977592 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:21:01.979090 44881 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1228 04:21:01.981534 44881 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1228 04:21:01.989768 44881 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1228 04:21:01.990689 44881 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1228 04:21:01.990881 44881 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1228 04:21:01.994144 44881 target.go:111] Terraform output is in /tmp/test123347195/out --- PASS: TestMinimalGCELongClusterName (1.63s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I1228 04:21:01.997297 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:01.999197 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:21:03.639237 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:21:03.639303 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:21:03.639407 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1228 04:21:03.639429 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1228 04:21:03.639444 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1228 04:21:03.639485 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1228 04:21:03.639518 44881 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1228 04:21:03.640483 44881 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1228 04:21:03.642333 44881 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1228 04:21:03.642648 44881 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1228 04:21:03.642789 44881 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1228 04:21:03.648976 44881 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1228 04:21:03.649804 44881 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1228 04:21:03.649938 44881 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1228 04:21:03.650039 44881 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1228 04:21:03.650130 44881 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1228 04:21:03.652235 44881 target.go:111] Terraform output is in /tmp/test1989531772/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.66s) === RUN TestMinimalGCEDNSNone I1228 04:21:03.654520 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:03.655608 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:21:05.248303 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:21:05.248354 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:21:05.248414 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1228 04:21:05.248429 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1228 04:21:05.248440 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1228 04:21:05.248470 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1228 04:21:05.248491 44881 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1228 04:21:05.249277 44881 executor.go:111] Tasks: 0 done / 72 total; 41 can run I1228 04:21:05.252045 44881 executor.go:111] Tasks: 41 done / 72 total; 18 can run I1228 04:21:05.252674 44881 executor.go:111] Tasks: 59 done / 72 total; 2 can run I1228 04:21:05.252958 44881 executor.go:111] Tasks: 61 done / 72 total; 2 can run I1228 04:21:05.257441 44881 executor.go:111] Tasks: 63 done / 72 total; 4 can run I1228 04:21:05.258050 44881 executor.go:111] Tasks: 67 done / 72 total; 2 can run I1228 04:21:05.258166 44881 executor.go:111] Tasks: 69 done / 72 total; 1 can run I1228 04:21:05.258266 44881 executor.go:111] Tasks: 70 done / 72 total; 2 can run I1228 04:21:05.258407 44881 executor.go:111] Tasks: 72 done / 72 total; 0 can run I1228 04:21:05.260537 44881 target.go:111] Terraform output is in /tmp/test1209692295/out --- PASS: TestMinimalGCEDNSNone (1.61s) === RUN TestMinimalScaleway I1228 04:21:05.262431 44881 featureflag.go:164] FeatureFlag "Scaleway"=true I1228 04:21:05.262445 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:07.652667 44881 executor.go:111] Tasks: 0 done / 49 total; 37 can run I1228 04:21:07.655512 44881 executor.go:111] Tasks: 37 done / 49 total; 6 can run I1228 04:21:07.662126 44881 executor.go:111] Tasks: 43 done / 49 total; 6 can run I1228 04:21:07.663266 44881 executor.go:111] Tasks: 49 done / 49 total; 0 can run I1228 04:21:07.665566 44881 target.go:111] Terraform output is in /tmp/test1015338220/out I1228 04:21:07.668853 44881 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (2.41s) === RUN TestHA I1228 04:21:07.669001 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:07.669131 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:07.669176 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:07.669232 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:07.669280 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:07.669332 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:07.669417 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:07.669452 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:07.669498 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:07.669528 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:07.704086 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:07.708480 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:07.708602 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:07.708702 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:07.708801 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:08.961264 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.107458 44881 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1228 04:21:09.108256 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:09.108293 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:09.108389 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:09.109739 44881 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1228 04:21:09.115372 44881 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1228 04:21:09.115568 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.115859 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116049 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116198 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116309 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116361 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116400 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116595 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:09.116698 44881 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1228 04:21:09.117042 44881 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1228 04:21:09.117419 44881 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1228 04:21:09.124356 44881 target.go:111] Terraform output is in /tmp/test1153868465/out --- PASS: TestHA (1.46s) === RUN TestHighAvailabilityGCE I1228 04:21:09.131208 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:09.132579 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:21:10.766274 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:21:10.766382 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:21:10.766486 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W1228 04:21:10.766514 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W1228 04:21:10.766540 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W1228 04:21:10.766597 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1228 04:21:10.766668 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1228 04:21:10.766730 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:21:10.767914 44881 executor.go:111] Tasks: 0 done / 82 total; 49 can run I1228 04:21:10.769876 44881 executor.go:111] Tasks: 49 done / 82 total; 19 can run I1228 04:21:10.777233 44881 executor.go:111] Tasks: 68 done / 82 total; 8 can run I1228 04:21:10.778147 44881 executor.go:111] Tasks: 76 done / 82 total; 6 can run I1228 04:21:10.778362 44881 executor.go:111] Tasks: 82 done / 82 total; 0 can run I1228 04:21:10.781268 44881 target.go:111] Terraform output is in /tmp/test3290915357/out --- PASS: TestHighAvailabilityGCE (1.65s) === RUN TestComplex I1228 04:21:10.783726 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:10.783807 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:10.783834 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:10.783889 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:10.783915 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:10.783945 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:10.783970 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:10.783989 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:10.784011 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:10.784029 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:10.808922 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:21:10.812739 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:10.812836 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:12.951598 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:13.130291 44881 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1228 04:21:13.130922 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:13.130946 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:13.131013 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:13.132957 44881 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1228 04:21:13.134878 44881 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1228 04:21:13.135390 44881 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1228 04:21:13.135585 44881 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1228 04:21:13.135650 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:13.135704 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:13.135852 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:13.135904 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:13.139264 44881 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1228 04:21:13.139372 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:13.139524 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:13.139837 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:13.139890 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:13.139940 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:21:13.140195 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:21:13.140415 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1228 04:21:13.147980 44881 target.go:111] Terraform output is in /tmp/test217986852/out I1228 04:21:13.150627 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:13.150699 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:13.150734 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:13.150780 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:13.150808 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:13.150842 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:13.150869 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:13.150887 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:13.150911 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:13.150929 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:13.181943 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:21:13.184679 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:13.184746 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:14.500018 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:14.658594 44881 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1228 04:21:14.659875 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:14.659923 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:14.660017 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:14.666697 44881 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1228 04:21:14.669895 44881 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1228 04:21:14.670481 44881 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1228 04:21:14.670627 44881 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1228 04:21:14.670665 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:14.670720 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:14.670807 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:14.670911 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:14.675773 44881 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1228 04:21:14.675922 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:14.676078 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:14.676312 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:14.676539 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:14.676609 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:21:14.676783 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:21:14.677049 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1228 04:21:14.683477 44881 target.go:111] Terraform output is in /tmp/test1647609254/out --- PASS: TestComplex (3.90s) === RUN TestCompress I1228 04:21:14.686822 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:14.686928 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:14.686957 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:14.687002 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:14.687029 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:14.687060 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:14.687112 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:14.687129 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:14.687152 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:14.687169 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:14.700932 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:14.704061 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:14.704173 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:16.137773 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:16.293312 44881 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1228 04:21:16.293614 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:16.293654 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:16.293728 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:16.295855 44881 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1228 04:21:16.299871 44881 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1228 04:21:16.300236 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:16.300496 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:16.302031 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:16.302445 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:16.302570 44881 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1228 04:21:16.302917 44881 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1228 04:21:16.303258 44881 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1228 04:21:16.308540 44881 target.go:111] Terraform output is in /tmp/test1287001319/out --- PASS: TestCompress (1.63s) === RUN TestExternalPolicies I1228 04:21:16.312892 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:16.313028 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:16.313070 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:16.313121 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:16.313167 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:16.313218 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:16.313300 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:16.313329 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:16.313368 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:16.313396 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:16.338308 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:16.340567 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:16.340629 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:17.595818 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:17.735802 44881 executor.go:111] Tasks: 0 done / 115 total; 47 can run I1228 04:21:17.736239 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:17.736263 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:17.736340 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:17.738279 44881 executor.go:111] Tasks: 47 done / 115 total; 22 can run I1228 04:21:17.741388 44881 executor.go:111] Tasks: 69 done / 115 total; 30 can run I1228 04:21:17.742052 44881 executor.go:111] Tasks: 99 done / 115 total; 4 can run W1228 04:21:17.742129 44881 api.go:53] PageSize not implemented W1228 04:21:17.742242 44881 api.go:53] PageSize not implemented I1228 04:21:17.751375 44881 executor.go:111] Tasks: 103 done / 115 total; 4 can run I1228 04:21:17.751507 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:17.751601 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:17.751995 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:17.752249 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:17.752371 44881 executor.go:111] Tasks: 107 done / 115 total; 2 can run I1228 04:21:17.752621 44881 executor.go:111] Tasks: 109 done / 115 total; 6 can run I1228 04:21:17.752936 44881 executor.go:111] Tasks: 115 done / 115 total; 0 can run I1228 04:21:17.756560 44881 target.go:111] Terraform output is in /tmp/test3953658612/out --- PASS: TestExternalPolicies (1.45s) === RUN TestMinimalIPv6 I1228 04:21:17.759259 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:17.759340 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:17.759367 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:17.759396 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:17.759420 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:17.759456 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:17.759506 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:17.759523 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:17.759548 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:17.759568 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:17.776421 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:17.778581 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:17.778634 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:18.989300 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:19.163840 44881 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1228 04:21:19.164716 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:19.164766 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:19.164863 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:19.173289 44881 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1228 04:21:19.176591 44881 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1228 04:21:19.177478 44881 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1228 04:21:19.178085 44881 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1228 04:21:19.178285 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:19.178382 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:19.178417 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:19.178506 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:19.184254 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:21:19.184459 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:19.184746 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:19.185250 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:19.185352 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:19.185468 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:21:19.185837 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:21:19.186181 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:21:19.193002 44881 target.go:111] Terraform output is in /tmp/test268980712/out --- PASS: TestMinimalIPv6 (1.44s) === RUN TestMinimalIPv6Calico I1228 04:21:19.197730 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:19.197851 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:19.197892 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:19.197940 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:19.197982 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:19.198032 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:19.198112 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:19.198142 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:19.198179 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:19.198208 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:19.228417 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:19.232064 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:19.232150 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:20.502571 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:20.951726 44881 executor.go:111] Tasks: 0 done / 138 total; 47 can run I1228 04:21:20.954140 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:20.954181 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:20.954275 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:20.958329 44881 executor.go:111] Tasks: 47 done / 138 total; 25 can run I1228 04:21:20.961910 44881 executor.go:111] Tasks: 72 done / 138 total; 37 can run I1228 04:21:20.962724 44881 executor.go:111] Tasks: 109 done / 138 total; 9 can run I1228 04:21:20.963277 44881 executor.go:111] Tasks: 118 done / 138 total; 8 can run I1228 04:21:20.963362 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:20.963459 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:20.963577 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:20.963654 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:20.969152 44881 executor.go:111] Tasks: 126 done / 138 total; 4 can run I1228 04:21:20.969340 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:20.969570 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:20.970061 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:20.970197 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:20.970316 44881 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1228 04:21:20.970627 44881 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1228 04:21:20.970998 44881 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1228 04:21:20.978187 44881 target.go:111] Terraform output is in /tmp/test698621960/out --- PASS: TestMinimalIPv6Calico (1.79s) === RUN TestMinimalIPv6Cilium I1228 04:21:20.983700 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:20.983837 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:20.983880 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:20.983926 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:20.983972 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:20.984024 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:20.984103 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:20.984133 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:20.984175 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:20.984203 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:21.013817 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:21.017278 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:21.017351 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:22.455735 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:22.687010 44881 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1228 04:21:22.687504 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:22.687559 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:22.687667 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:22.690554 44881 executor.go:111] Tasks: 47 done / 137 total; 25 can run I1228 04:21:22.693928 44881 executor.go:111] Tasks: 72 done / 137 total; 36 can run I1228 04:21:22.694733 44881 executor.go:111] Tasks: 108 done / 137 total; 9 can run I1228 04:21:22.695198 44881 executor.go:111] Tasks: 117 done / 137 total; 8 can run I1228 04:21:22.695361 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:22.695456 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:22.695568 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:22.695649 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:22.701056 44881 executor.go:111] Tasks: 125 done / 137 total; 4 can run I1228 04:21:22.701225 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:22.701402 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:22.701848 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:22.701935 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:22.702036 44881 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1228 04:21:22.702338 44881 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1228 04:21:22.702683 44881 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1228 04:21:22.709650 44881 target.go:111] Terraform output is in /tmp/test1935758769/out --- PASS: TestMinimalIPv6Cilium (1.73s) === RUN TestMinimalIPv6NoSubnetPrefix I1228 04:21:22.715133 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:22.715265 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:22.715306 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:22.715352 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:22.715392 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:22.715455 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:22.715538 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:22.715567 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:22.715605 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:22.715636 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:22.750478 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:22.754461 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:22.754553 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:24.064282 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:24.246283 44881 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1228 04:21:24.246970 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:24.247018 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:24.247152 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:24.252571 44881 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1228 04:21:24.257151 44881 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1228 04:21:24.258010 44881 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1228 04:21:24.258525 44881 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1228 04:21:24.258587 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:24.258656 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:24.258890 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:21:24.258968 44881 loadbalancers.go:35] PageSize not implemented I1228 04:21:24.264369 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:21:24.264541 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:24.264732 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:24.265007 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:24.265464 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:24.265565 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:21:24.265864 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:21:24.266183 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:21:24.273065 44881 target.go:111] Terraform output is in /tmp/test3023964773/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.56s) === RUN TestMinimalWarmPool I1228 04:21:24.277783 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:24.277903 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:24.277956 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:24.278005 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:24.278052 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:24.278113 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:24.278195 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:24.278225 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:24.278263 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:24.278289 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:24.304377 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:24.307907 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:24.307989 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:25.560653 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:25.788595 44881 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1228 04:21:25.789521 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:25.789588 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:25.789720 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:25.792438 44881 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1228 04:21:25.798518 44881 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1228 04:21:25.799020 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:25.799262 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:25.799511 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:25.800106 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:25.800269 44881 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1228 04:21:25.800651 44881 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1228 04:21:25.800986 44881 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1228 04:21:25.806460 44881 target.go:111] Terraform output is in /tmp/test574201812/out --- PASS: TestMinimalWarmPool (1.54s) === RUN TestMinimalEtcd I1228 04:21:25.815304 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:25.815447 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:25.815489 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:25.815540 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:25.815589 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:25.815641 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:25.815724 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:25.815754 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:25.815790 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:25.815819 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:25.842780 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:25.846133 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:25.846219 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:27.099938 44881 zones.go:93] ListHostedZonesPages { } W1228 04:21:27.262302 44881 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W1228 04:21:27.262373 44881 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W1228 04:21:27.265108 44881 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I1228 04:21:27.277168 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:21:27.277680 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:27.277737 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:27.277842 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:27.280407 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:21:27.290827 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:21:27.291054 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:27.291566 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:27.291803 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:27.292192 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:27.292397 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:21:27.292845 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:21:27.293192 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:21:27.298458 44881 target.go:111] Terraform output is in /tmp/test3113335349/out --- PASS: TestMinimalEtcd (1.49s) === RUN TestMinimalGp3 I1228 04:21:27.302973 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:27.303102 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:27.303146 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:27.303194 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:27.303238 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:27.303288 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:27.303377 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:27.303408 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:27.303446 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:27.303475 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:27.329007 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:27.332276 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:27.332364 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:28.596830 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:28.765708 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:21:28.766182 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:28.766213 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:28.768038 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:28.774406 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:21:28.781048 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:21:28.781646 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:28.781898 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:28.782363 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:28.782443 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:28.782576 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:21:28.782926 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:21:28.783277 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:21:28.788544 44881 target.go:111] Terraform output is in /tmp/test3214734231/out --- PASS: TestMinimalGp3 (1.49s) === RUN TestMinimalLongClusterName I1228 04:21:28.792994 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:28.793114 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:28.793155 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:28.793203 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:28.793251 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:28.793302 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:28.793381 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:28.793413 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:28.793454 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:28.793486 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:28.818382 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:28.821562 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:28.821648 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1228 04:21:30.039718 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:30.222951 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:21:30.223417 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:30.223465 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:30.223605 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:30.229212 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:21:30.236102 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:21:30.236631 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.236836 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.237125 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.237605 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.237749 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:21:30.238099 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:21:30.238502 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:21:30.244421 44881 target.go:111] Terraform output is in /tmp/test2925358359/out --- PASS: TestMinimalLongClusterName (1.46s) === RUN TestExistingSG I1228 04:21:30.249099 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:30.249230 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:30.249272 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:30.249324 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:30.249367 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:30.249419 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:30.249507 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:30.249537 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:30.249578 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:30.249607 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:30.283528 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:30.286826 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.286933 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.286986 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:30.287033 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:31.682479 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:31.990593 44881 executor.go:111] Tasks: 0 done / 163 total; 53 can run I1228 04:21:31.991196 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:31.991256 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:31.991383 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:31.994335 44881 executor.go:111] Tasks: 53 done / 163 total; 26 can run I1228 04:21:31.997568 44881 executor.go:111] Tasks: 79 done / 163 total; 54 can run I1228 04:21:31.998949 44881 executor.go:111] Tasks: 133 done / 163 total; 6 can run W1228 04:21:31.999095 44881 api.go:53] PageSize not implemented W1228 04:21:31.999216 44881 api.go:53] PageSize not implemented W1228 04:21:31.999346 44881 api.go:53] PageSize not implemented W1228 04:21:31.999471 44881 api.go:53] PageSize not implemented I1228 04:21:32.005099 44881 executor.go:111] Tasks: 139 done / 163 total; 8 can run I1228 04:21:32.005288 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.005418 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.005621 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.005736 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.005830 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.006106 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.006204 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.006263 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.006354 44881 executor.go:111] Tasks: 147 done / 163 total; 4 can run I1228 04:21:32.006803 44881 executor.go:111] Tasks: 151 done / 163 total; 12 can run I1228 04:21:32.007208 44881 executor.go:111] Tasks: 163 done / 163 total; 0 can run I1228 04:21:32.020026 44881 target.go:111] Terraform output is in /tmp/test2885220800/out --- PASS: TestExistingSG (1.78s) === RUN TestBastionAdditionalUserData I1228 04:21:32.025510 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:32.025636 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:32.025678 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:32.025725 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:32.025766 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:32.025817 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:32.025904 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:32.025937 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:32.025975 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:32.026004 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:32.055773 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:32.059240 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.059331 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:32.059393 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.341575 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:33.495164 44881 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1228 04:21:33.496199 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:33.496231 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:33.496289 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:33.499476 44881 executor.go:111] Tasks: 47 done / 137 total; 30 can run I1228 04:21:33.505178 44881 executor.go:111] Tasks: 77 done / 137 total; 35 can run I1228 04:21:33.506291 44881 executor.go:111] Tasks: 112 done / 137 total; 6 can run W1228 04:21:33.506355 44881 api.go:53] PageSize not implemented W1228 04:21:33.506482 44881 api.go:53] PageSize not implemented W1228 04:21:33.506608 44881 api.go:53] PageSize not implemented I1228 04:21:33.512107 44881 executor.go:111] Tasks: 118 done / 137 total; 7 can run I1228 04:21:33.512285 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.512511 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.512782 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.512878 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.513151 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.513638 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.513738 44881 executor.go:111] Tasks: 125 done / 137 total; 3 can run I1228 04:21:33.514120 44881 executor.go:111] Tasks: 128 done / 137 total; 9 can run I1228 04:21:33.514483 44881 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1228 04:21:33.521560 44881 target.go:111] Terraform output is in /tmp/test447613526/out --- PASS: TestBastionAdditionalUserData (1.50s) === RUN TestPrivateFlannel I1228 04:21:33.526633 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:33.526766 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:33.526808 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:33.526874 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:33.526920 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:33.526970 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:33.527050 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:33.527079 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:33.527119 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:33.527148 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:33.555911 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:33.559088 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.559168 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:33.559226 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:34.788212 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:34.993003 44881 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1228 04:21:34.999789 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:34.999826 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:34.999925 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:35.002193 44881 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1228 04:21:35.005609 44881 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1228 04:21:35.006253 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.006487 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.006606 44881 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1228 04:21:35.006719 44881 api.go:53] PageSize not implemented W1228 04:21:35.006873 44881 api.go:53] PageSize not implemented I1228 04:21:35.012695 44881 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1228 04:21:35.012905 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.013040 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.013602 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.013738 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.013852 44881 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1228 04:21:35.014126 44881 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1228 04:21:35.014527 44881 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1228 04:21:35.021525 44881 target.go:111] Terraform output is in /tmp/test2372466247/out --- PASS: TestPrivateFlannel (1.50s) === RUN TestPrivateCalico I1228 04:21:35.026507 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:35.026634 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:35.026681 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:35.026736 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:35.026779 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:35.026829 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:35.026941 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:35.026979 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:35.027020 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:35.027051 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:35.060621 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:35.064530 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.064731 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:35.064855 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.293749 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:36.725065 44881 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1228 04:21:36.727149 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:36.727221 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:36.727391 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:36.733537 44881 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1228 04:21:36.737077 44881 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1228 04:21:36.737849 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.738006 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.738130 44881 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1228 04:21:36.738257 44881 api.go:53] PageSize not implemented W1228 04:21:36.738453 44881 api.go:53] PageSize not implemented I1228 04:21:36.744313 44881 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1228 04:21:36.744537 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.744816 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.745284 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.745375 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.745490 44881 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1228 04:21:36.745781 44881 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1228 04:21:36.746141 44881 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1228 04:21:36.753737 44881 target.go:111] Terraform output is in /tmp/test1788304013/out --- PASS: TestPrivateCalico (1.73s) === RUN TestPrivateCilium I1228 04:21:36.759626 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:36.759761 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:36.759803 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:36.759851 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:36.759897 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:36.759951 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:36.760036 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:36.760067 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:36.760106 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:36.760135 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:36.795099 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:36.798919 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.799010 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:36.799069 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.062758 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:38.288819 44881 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1228 04:21:38.290530 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:38.290568 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:38.290646 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:38.297990 44881 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1228 04:21:38.301339 44881 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1228 04:21:38.301860 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.302037 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.302243 44881 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1228 04:21:38.302335 44881 api.go:53] PageSize not implemented W1228 04:21:38.302499 44881 api.go:53] PageSize not implemented I1228 04:21:38.308296 44881 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1228 04:21:38.308489 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.308701 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.309010 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.309523 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.309644 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:21:38.309969 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:21:38.310381 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:21:38.317497 44881 target.go:111] Terraform output is in /tmp/test303238422/out --- PASS: TestPrivateCilium (1.56s) === RUN TestPrivateCilium2 I1228 04:21:38.322450 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:38.322616 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:38.322657 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:38.322702 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:38.322740 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:38.322794 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:38.322873 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:38.322902 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:38.322941 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:38.322970 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:38.352034 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:21:38.355390 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.355461 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:38.355512 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:39.647100 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:40.332534 44881 executor.go:111] Tasks: 0 done / 138 total; 50 can run I1228 04:21:40.333044 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:40.333068 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:40.333127 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:40.336112 44881 executor.go:111] Tasks: 50 done / 138 total; 30 can run I1228 04:21:40.339088 44881 executor.go:111] Tasks: 80 done / 138 total; 36 can run I1228 04:21:40.339549 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.339722 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.339810 44881 executor.go:111] Tasks: 116 done / 138 total; 6 can run W1228 04:21:40.339846 44881 api.go:53] PageSize not implemented W1228 04:21:40.339903 44881 api.go:53] PageSize not implemented I1228 04:21:40.345417 44881 executor.go:111] Tasks: 122 done / 138 total; 8 can run I1228 04:21:40.345647 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.345812 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.346018 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.346421 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.346521 44881 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1228 04:21:40.346773 44881 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1228 04:21:40.347053 44881 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1228 04:21:40.354574 44881 target.go:111] Terraform output is in /tmp/test2079303535/out --- PASS: TestPrivateCilium2 (2.05s) === RUN TestPrivateCiliumAdvanced I1228 04:21:40.369943 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:40.370103 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:40.370152 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:40.370226 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:40.370270 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:40.370324 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:40.370418 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:40.370448 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:40.370488 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:40.370518 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:40.404302 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:40.408429 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.408516 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:40.408570 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.697225 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:41.926673 44881 executor.go:111] Tasks: 0 done / 142 total; 54 can run I1228 04:21:41.927278 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:41.927331 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:41.927433 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:41.930160 44881 executor.go:111] Tasks: 54 done / 142 total; 30 can run I1228 04:21:41.933711 44881 executor.go:111] Tasks: 84 done / 142 total; 36 can run I1228 04:21:41.934066 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.934213 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.934559 44881 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1228 04:21:41.934819 44881 api.go:53] PageSize not implemented W1228 04:21:41.934947 44881 api.go:53] PageSize not implemented I1228 04:21:41.941540 44881 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1228 04:21:41.941902 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.942180 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.942383 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.942920 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.943033 44881 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1228 04:21:41.943329 44881 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1228 04:21:41.943743 44881 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1228 04:21:41.950859 44881 target.go:111] Terraform output is in /tmp/test3865080442/out --- PASS: TestPrivateCiliumAdvanced (1.59s) === RUN TestPrivateCiliumENI I1228 04:21:41.956346 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:41.956473 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:41.956517 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:41.956566 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:41.956613 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:41.956676 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:41.956759 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:41.956791 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:41.956835 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:41.956887 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:41.991521 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:41.995322 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.995434 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:41.995531 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.260824 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:43.475643 44881 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1228 04:21:43.476897 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:43.476938 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:43.477057 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:43.478767 44881 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1228 04:21:43.481755 44881 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1228 04:21:43.482318 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.482473 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.482676 44881 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1228 04:21:43.482792 44881 api.go:53] PageSize not implemented W1228 04:21:43.482855 44881 api.go:53] PageSize not implemented I1228 04:21:43.488612 44881 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1228 04:21:43.488825 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.489072 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.489515 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.489600 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.489682 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:21:43.489931 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:21:43.490272 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:21:43.497211 44881 target.go:111] Terraform output is in /tmp/test1071515426/out --- PASS: TestPrivateCiliumENI (1.55s) === RUN TestPrivateCanal I1228 04:21:43.502165 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:43.502295 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:43.502336 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:43.502381 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:43.502420 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:43.502469 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:43.502547 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:43.502580 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:43.502621 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:43.502649 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:43.530966 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:21:43.534186 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.534259 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:43.534312 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:44.792433 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:45.223834 44881 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1228 04:21:45.225862 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:45.225897 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:45.226000 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:45.231945 44881 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1228 04:21:45.235042 44881 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1228 04:21:45.235484 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.235637 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.235944 44881 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1228 04:21:45.236153 44881 api.go:53] PageSize not implemented W1228 04:21:45.236221 44881 api.go:53] PageSize not implemented I1228 04:21:45.241866 44881 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1228 04:21:45.242044 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.242269 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.242525 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.243010 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.243125 44881 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1228 04:21:45.243427 44881 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1228 04:21:45.243821 44881 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1228 04:21:45.250929 44881 target.go:111] Terraform output is in /tmp/test143123617/out --- PASS: TestPrivateCanal (1.75s) === RUN TestPrivateKopeio I1228 04:21:45.256569 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:45.256717 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:45.256760 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:45.256804 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:45.256861 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:45.256914 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:45.256996 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:45.257025 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:45.257063 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:45.257093 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:45.291202 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:45.296154 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.296339 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:45.296464 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.559313 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:46.762777 44881 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1228 04:21:46.763612 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:46.763650 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:46.763744 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:46.765695 44881 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1228 04:21:46.769206 44881 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1228 04:21:46.769448 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.769596 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.769965 44881 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1228 04:21:46.770029 44881 api.go:53] PageSize not implemented W1228 04:21:46.770283 44881 api.go:53] PageSize not implemented I1228 04:21:46.775726 44881 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1228 04:21:46.777002 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.777259 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.778033 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.778858 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.779103 44881 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1228 04:21:46.780569 44881 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1228 04:21:46.781592 44881 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1228 04:21:46.790319 44881 target.go:111] Terraform output is in /tmp/test3321967121/out --- PASS: TestPrivateKopeio (1.55s) === RUN TestUnmanaged I1228 04:21:46.808606 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:46.808748 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:46.808793 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:46.808843 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:46.808889 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:46.808944 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:46.809029 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:46.809059 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:46.809099 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:46.809129 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:46.839347 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:46.842764 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.842849 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:46.842909 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.122990 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:48.300053 44881 executor.go:111] Tasks: 0 done / 126 total; 46 can run I1228 04:21:48.300455 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:48.300517 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:48.300680 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:48.303663 44881 executor.go:111] Tasks: 46 done / 126 total; 27 can run I1228 04:21:48.307209 44881 executor.go:111] Tasks: 73 done / 126 total; 33 can run I1228 04:21:48.307769 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.307954 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.308193 44881 executor.go:111] Tasks: 106 done / 126 total; 5 can run W1228 04:21:48.308297 44881 api.go:53] PageSize not implemented W1228 04:21:48.308351 44881 api.go:53] PageSize not implemented I1228 04:21:48.314009 44881 executor.go:111] Tasks: 111 done / 126 total; 7 can run I1228 04:21:48.314274 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.314513 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.314984 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.315074 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.315158 44881 executor.go:111] Tasks: 118 done / 126 total; 2 can run I1228 04:21:48.315464 44881 executor.go:111] Tasks: 120 done / 126 total; 6 can run I1228 04:21:48.315806 44881 executor.go:111] Tasks: 126 done / 126 total; 0 can run I1228 04:21:48.322470 44881 target.go:111] Terraform output is in /tmp/test1281554210/out --- PASS: TestUnmanaged (1.52s) === RUN TestPrivateSharedSubnet I1228 04:21:48.327226 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:48.327350 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:48.327397 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:48.327442 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:48.327481 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:48.327533 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:48.327613 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:48.327643 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:48.327681 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:48.327707 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:48.356041 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:48.361402 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.361668 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:48.361906 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.637585 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:49.819510 44881 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1228 04:21:49.822170 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:49.822198 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:49.822267 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:49.824640 44881 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1228 04:21:49.824923 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:21:49.827978 44881 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1228 04:21:49.828483 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.828635 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.828824 44881 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1228 04:21:49.828933 44881 api.go:53] PageSize not implemented W1228 04:21:49.829060 44881 api.go:53] PageSize not implemented I1228 04:21:49.838376 44881 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1228 04:21:49.838704 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.838832 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.839200 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.839667 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.839848 44881 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1228 04:21:49.840353 44881 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1228 04:21:49.840848 44881 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1228 04:21:49.847657 44881 target.go:111] Terraform output is in /tmp/test3071781889/out --- PASS: TestPrivateSharedSubnet (1.53s) === RUN TestPrivateSharedIP I1228 04:21:49.852427 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:49.852556 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:49.852597 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:49.852645 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:49.852689 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:49.852740 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:49.852819 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:49.852848 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:49.852885 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:49.852912 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:49.881247 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:49.884691 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.884784 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:49.884843 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.139608 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:51.317335 44881 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1228 04:21:51.319113 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:51.319162 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:51.319265 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:51.322167 44881 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1228 04:21:51.322553 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:21:51.325346 44881 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1228 04:21:51.326100 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.326253 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.326348 44881 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1228 04:21:51.326402 44881 api.go:53] PageSize not implemented W1228 04:21:51.326627 44881 api.go:53] PageSize not implemented I1228 04:21:51.332283 44881 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1228 04:21:51.332568 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.332796 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.333020 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.333479 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.333599 44881 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1228 04:21:51.333898 44881 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1228 04:21:51.334215 44881 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1228 04:21:51.340809 44881 target.go:111] Terraform output is in /tmp/test1356920643/out --- PASS: TestPrivateSharedIP (1.49s) === RUN TestPrivateDns1 I1228 04:21:51.345615 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:51.345736 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:51.345776 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:51.345823 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:51.345866 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:51.345917 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:51.345998 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:51.346028 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:51.346068 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:51.346097 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1228 04:21:51.382351 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.382449 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:51.382509 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.048008 44881 executor.go:111] Tasks: 0 done / 135 total; 46 can run I1228 04:21:53.056281 44881 executor.go:111] Tasks: 46 done / 135 total; 28 can run I1228 04:21:53.056919 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I1228 04:21:53.056975 44881 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I1228 04:21:53.057078 44881 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I1228 04:21:53.057097 44881 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I1228 04:21:53.057197 44881 executor.go:111] Tasks: 74 done / 135 total; 39 can run I1228 04:21:53.057557 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.057742 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.060444 44881 executor.go:111] Tasks: 113 done / 135 total; 6 can run W1228 04:21:53.060621 44881 api.go:53] PageSize not implemented W1228 04:21:53.060675 44881 api.go:53] PageSize not implemented I1228 04:21:53.066463 44881 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1228 04:21:53.066658 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.066806 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.067140 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.067748 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.067871 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:21:53.068195 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:21:53.068540 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1228 04:21:53.075666 44881 target.go:111] Terraform output is in /tmp/test2492419447/out --- PASS: TestPrivateDns1 (1.73s) === RUN TestPrivateDns2 I1228 04:21:53.080478 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:53.080602 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:53.080643 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:53.080688 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:53.080738 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:53.080791 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:53.080871 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:53.080903 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:53.080941 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:53.080969 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:53.119206 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.119302 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:53.119365 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.541077 44881 executor.go:111] Tasks: 0 done / 132 total; 45 can run I1228 04:21:54.545613 44881 executor.go:111] Tasks: 45 done / 132 total; 26 can run I1228 04:21:54.545863 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:21:54.546113 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I1228 04:21:54.546162 44881 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I1228 04:21:54.546249 44881 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I1228 04:21:54.546270 44881 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I1228 04:21:54.546330 44881 executor.go:111] Tasks: 71 done / 132 total; 39 can run I1228 04:21:54.548286 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.548572 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.554354 44881 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1228 04:21:54.554477 44881 api.go:53] PageSize not implemented W1228 04:21:54.554905 44881 api.go:53] PageSize not implemented I1228 04:21:54.560485 44881 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1228 04:21:54.560800 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.560927 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.561314 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.562165 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.562310 44881 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1228 04:21:54.562673 44881 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1228 04:21:54.562988 44881 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1228 04:21:54.570090 44881 target.go:111] Terraform output is in /tmp/test2356831222/out --- PASS: TestPrivateDns2 (1.49s) === RUN TestDiscoveryFeatureGate I1228 04:21:54.574966 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:54.575086 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:54.575126 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:54.575212 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:54.575254 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:54.575304 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:54.575345 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:54.575376 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:54.575414 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:54.575444 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:54.601272 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:21:54.604653 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:54.604738 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:55.844311 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:56.069212 44881 executor.go:111] Tasks: 0 done / 113 total; 52 can run I1228 04:21:56.069950 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:56.070004 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:56.070140 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:56.072874 44881 executor.go:111] Tasks: 52 done / 113 total; 28 can run I1228 04:21:56.079619 44881 executor.go:111] Tasks: 80 done / 113 total; 25 can run I1228 04:21:56.079892 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:56.080142 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:56.080623 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:56.080717 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:56.080799 44881 executor.go:111] Tasks: 105 done / 113 total; 2 can run I1228 04:21:56.081076 44881 executor.go:111] Tasks: 107 done / 113 total; 6 can run I1228 04:21:56.081472 44881 executor.go:111] Tasks: 113 done / 113 total; 0 can run I1228 04:21:56.087860 44881 target.go:111] Terraform output is in /tmp/test1500801250/out --- PASS: TestDiscoveryFeatureGate (1.52s) === RUN TestVFSServiceAccountIssuerDiscovery I1228 04:21:56.097133 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:56.097288 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:56.097337 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:56.097388 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:56.097430 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:56.097486 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:56.097578 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:56.097608 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:56.097647 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:56.097676 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:56.123103 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:56.126302 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:56.126405 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:57.374206 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:57.527923 44881 executor.go:111] Tasks: 0 done / 104 total; 47 can run I1228 04:21:57.528309 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:57.528329 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:57.528383 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:57.535444 44881 executor.go:111] Tasks: 47 done / 104 total; 24 can run I1228 04:21:57.541920 44881 executor.go:111] Tasks: 71 done / 104 total; 25 can run I1228 04:21:57.542478 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:57.542717 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:57.543017 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:57.543570 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:57.543686 44881 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1228 04:21:57.544059 44881 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1228 04:21:57.544450 44881 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1228 04:21:57.549931 44881 target.go:111] Terraform output is in /tmp/test667365188/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.46s) === RUN TestAWSLBController I1228 04:21:57.554699 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:57.554822 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:57.554864 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:57.554908 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:57.554949 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:57.554997 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:57.555079 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:57.555108 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:57.555150 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:57.555180 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:57.581241 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:57.585849 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:57.586382 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:58.849618 44881 zones.go:93] ListHostedZonesPages { } I1228 04:21:59.602216 44881 executor.go:111] Tasks: 0 done / 116 total; 54 can run I1228 04:21:59.606482 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:21:59.606532 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:21:59.606625 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:21:59.608840 44881 executor.go:111] Tasks: 54 done / 116 total; 29 can run I1228 04:21:59.620451 44881 executor.go:111] Tasks: 83 done / 116 total; 25 can run I1228 04:21:59.620821 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:59.621056 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:59.621283 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:59.621954 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:59.622086 44881 executor.go:111] Tasks: 108 done / 116 total; 2 can run I1228 04:21:59.622428 44881 executor.go:111] Tasks: 110 done / 116 total; 6 can run I1228 04:21:59.622784 44881 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1228 04:21:59.630322 44881 target.go:111] Terraform output is in /tmp/test761590798/out --- PASS: TestAWSLBController (2.08s) === RUN TestManyAddons I1228 04:21:59.639081 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:59.639209 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:59.639254 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:59.639306 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:59.639349 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:59.639412 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:59.639500 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:59.639531 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:59.639569 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:59.639600 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:59.667253 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:21:59.671906 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:21:59.672060 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:00.930008 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:01.777868 44881 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1228 04:22:01.784899 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:01.784956 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:01.785059 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:01.788206 44881 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1228 04:22:01.794335 44881 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1228 04:22:01.794918 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:01.795201 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:01.795649 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:01.796305 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:01.796428 44881 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1228 04:22:01.796814 44881 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1228 04:22:01.797189 44881 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1228 04:22:01.803566 44881 target.go:111] Terraform output is in /tmp/test1435817450/out --- PASS: TestManyAddons (2.18s) === RUN TestManyAddonsCCMIRSA I1228 04:22:01.816287 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:01.816570 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:01.816668 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:01.816786 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:01.816934 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:01.817064 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:01.817180 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:01.817213 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:01.817252 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:01.817282 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:01.847555 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:01.851198 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:01.851287 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:03.127489 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:04.032585 44881 executor.go:111] Tasks: 0 done / 123 total; 59 can run I1228 04:22:04.034305 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:04.034337 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:04.034420 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:04.041871 44881 executor.go:111] Tasks: 59 done / 123 total; 30 can run I1228 04:22:04.048093 44881 executor.go:111] Tasks: 89 done / 123 total; 26 can run I1228 04:22:04.048387 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:04.048690 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:04.049148 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:04.049297 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:04.049405 44881 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1228 04:22:04.049683 44881 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1228 04:22:04.049987 44881 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1228 04:22:04.062037 44881 target.go:111] Terraform output is in /tmp/test4198796591/out --- PASS: TestManyAddonsCCMIRSA (2.26s) === RUN TestManyAddonsCCMIRSA23 I1228 04:22:04.073354 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:04.073588 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:04.073643 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:04.073695 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:04.073740 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:04.073806 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:04.073895 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:04.073928 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:04.073968 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:04.073998 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:04.101944 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1228 04:22:04.105085 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:04.105163 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:05.377860 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:06.260380 44881 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1228 04:22:06.261027 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:06.261065 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:06.261151 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:06.264694 44881 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1228 04:22:06.271309 44881 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1228 04:22:06.271695 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:06.271825 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:06.272279 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:06.272418 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:06.272522 44881 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1228 04:22:06.272820 44881 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1228 04:22:06.273184 44881 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1228 04:22:06.281458 44881 target.go:111] Terraform output is in /tmp/test884861838/out --- PASS: TestManyAddonsCCMIRSA23 (2.22s) === RUN TestManyAddonsCCMIRSA24 I1228 04:22:06.297084 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:06.297234 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:06.297280 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:06.297331 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:06.297375 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:06.297427 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:06.297509 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:06.297540 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:06.297579 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:06.297609 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:06.325302 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:22:06.328980 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:06.329075 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:07.581242 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:08.449983 44881 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1228 04:22:08.451575 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:08.451629 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:08.451764 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:08.454559 44881 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1228 04:22:08.461221 44881 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1228 04:22:08.461685 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:08.461933 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:08.462401 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:08.462472 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:08.462585 44881 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1228 04:22:08.462876 44881 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1228 04:22:08.463281 44881 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1228 04:22:08.474908 44881 target.go:111] Terraform output is in /tmp/test2176421202/out --- PASS: TestManyAddonsCCMIRSA24 (2.19s) === RUN TestManyAddonsCCMIRSA25 I1228 04:22:08.486246 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:08.486382 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:08.486429 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:08.486530 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:08.486576 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:08.486628 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:08.486671 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:08.486704 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:08.486744 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:08.486775 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:08.514919 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:22:08.518247 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:08.518333 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:09.528399 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:10.407233 44881 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1228 04:22:10.415625 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:10.415669 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:10.415764 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:10.418047 44881 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1228 04:22:10.424572 44881 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1228 04:22:10.425010 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:10.425304 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:10.425801 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:10.425893 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:10.425979 44881 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1228 04:22:10.426250 44881 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1228 04:22:10.426639 44881 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1228 04:22:10.434722 44881 target.go:111] Terraform output is in /tmp/test2820458788/out --- PASS: TestManyAddonsCCMIRSA25 (1.96s) === RUN TestManyAddonsCCMIRSA26 I1228 04:22:10.449751 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:10.450000 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:10.450092 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:10.450221 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:10.450325 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:10.450423 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:10.450588 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:10.450644 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:10.450720 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:10.450753 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:10.481409 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:22:10.484902 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:10.484989 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:11.721277 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:12.637667 44881 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1228 04:22:12.639694 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:12.639719 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:12.639783 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:12.643730 44881 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1228 04:22:12.654423 44881 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1228 04:22:12.654853 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:12.655554 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:12.655843 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:12.656286 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:12.656403 44881 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1228 04:22:12.656655 44881 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1228 04:22:12.657069 44881 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1228 04:22:12.664929 44881 target.go:111] Terraform output is in /tmp/test3488857863/out --- PASS: TestManyAddonsCCMIRSA26 (2.22s) === RUN TestManyAddonsGCE I1228 04:22:12.674090 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:22:14.849453 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:22:14.849530 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:22:14.849604 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W1228 04:22:14.849626 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W1228 04:22:14.849640 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W1228 04:22:14.849681 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:22:14.850609 44881 executor.go:111] Tasks: 0 done / 67 total; 44 can run I1228 04:22:14.859350 44881 executor.go:111] Tasks: 44 done / 67 total; 17 can run I1228 04:22:14.865521 44881 executor.go:111] Tasks: 61 done / 67 total; 4 can run I1228 04:22:14.866491 44881 executor.go:111] Tasks: 65 done / 67 total; 2 can run I1228 04:22:14.866709 44881 executor.go:111] Tasks: 67 done / 67 total; 0 can run I1228 04:22:14.870911 44881 target.go:111] Terraform output is in /tmp/test2129198544/out --- PASS: TestManyAddonsGCE (2.20s) === RUN TestCCM I1228 04:22:14.878199 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:14.878333 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:14.878380 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:14.878473 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:14.878519 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:14.878571 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:14.878614 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:14.878646 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:14.878685 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:14.878714 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:14.906492 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:14.909933 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:14.910021 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:16.126733 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:16.981136 44881 executor.go:111] Tasks: 0 done / 110 total; 51 can run I1228 04:22:16.984702 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:16.984768 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:16.984936 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:16.991360 44881 executor.go:111] Tasks: 51 done / 110 total; 24 can run I1228 04:22:16.998867 44881 executor.go:111] Tasks: 75 done / 110 total; 27 can run I1228 04:22:16.999403 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:16.999627 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:16.999894 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:17.000407 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:17.000509 44881 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1228 04:22:17.000894 44881 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1228 04:22:17.001283 44881 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1228 04:22:17.007873 44881 target.go:111] Terraform output is in /tmp/test3812693121/out --- PASS: TestCCM (2.14s) === RUN TestExternalDNS I1228 04:22:17.020138 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:17.020312 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:17.020361 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:17.020414 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:17.020461 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:17.020515 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:17.020605 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:17.020636 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:17.020677 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:17.020707 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:17.048438 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:17.051641 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:17.051735 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:18.553467 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:18.742110 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:22:18.742884 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:18.742933 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:18.743025 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:18.747066 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:22:18.756266 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:22:18.756697 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:18.756942 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:18.757449 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:18.757534 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:18.757625 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:22:18.758007 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:22:18.758341 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:18.764132 44881 target.go:111] Terraform output is in /tmp/test2574957266/out --- PASS: TestExternalDNS (1.76s) === RUN TestExternalDNSIRSA I1228 04:22:18.776447 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:18.776606 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:18.776657 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:18.776737 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:18.776803 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:18.776906 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:18.777013 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:18.777076 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:18.777146 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:18.777194 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:18.803351 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:18.806702 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:18.806811 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.074600 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:20.306382 44881 executor.go:111] Tasks: 0 done / 112 total; 51 can run I1228 04:22:20.306963 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:20.306991 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:20.307070 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:20.313580 44881 executor.go:111] Tasks: 51 done / 112 total; 28 can run I1228 04:22:20.320874 44881 executor.go:111] Tasks: 79 done / 112 total; 25 can run I1228 04:22:20.321337 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.321491 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.321776 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.322206 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.322312 44881 executor.go:111] Tasks: 104 done / 112 total; 2 can run I1228 04:22:20.322617 44881 executor.go:111] Tasks: 106 done / 112 total; 6 can run I1228 04:22:20.323030 44881 executor.go:111] Tasks: 112 done / 112 total; 0 can run I1228 04:22:20.329261 44881 target.go:111] Terraform output is in /tmp/test1859387918/out --- PASS: TestExternalDNSIRSA (1.56s) === RUN TestKarpenter I1228 04:22:20.334934 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:20.335064 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:20.335108 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:20.335156 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:20.335198 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:20.335248 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:20.335331 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:20.335364 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:20.335403 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:20.335431 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:20.372102 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:22:20.376257 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.376347 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:20.376406 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:21.685030 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:21.895170 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:21.895284 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:21.895383 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1228 04:22:22.044299 44881 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W1228 04:22:22.044373 44881 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1228 04:22:22.044392 44881 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W1228 04:22:22.044412 44881 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1228 04:22:22.044434 44881 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I1228 04:22:22.065768 44881 executor.go:111] Tasks: 0 done / 122 total; 54 can run I1228 04:22:22.067371 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:22.067414 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:22.067551 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:22.074966 44881 executor.go:111] Tasks: 54 done / 122 total; 31 can run I1228 04:22:22.081557 44881 executor.go:111] Tasks: 85 done / 122 total; 29 can run I1228 04:22:22.081876 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.082073 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.082335 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.082628 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.082776 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.083117 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.083284 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.083380 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.083528 44881 executor.go:111] Tasks: 114 done / 122 total; 2 can run I1228 04:22:22.083933 44881 executor.go:111] Tasks: 116 done / 122 total; 6 can run I1228 04:22:22.084306 44881 executor.go:111] Tasks: 122 done / 122 total; 0 can run I1228 04:22:22.091924 44881 target.go:111] Terraform output is in /tmp/test319985934/out --- PASS: TestKarpenter (1.76s) === RUN TestSharedSubnet I1228 04:22:22.098716 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:22.098843 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:22.098885 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:22.098929 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:22.098971 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:22.099043 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:22.099123 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:22.099153 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:22.099190 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:22.099219 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:22.129788 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:22.132972 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:22.133066 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:23.597940 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:23.790135 44881 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1228 04:22:23.790731 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:23.790767 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:23.790862 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:23.794211 44881 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1228 04:22:23.795736 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:22:23.804188 44881 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1228 04:22:23.804530 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:23.804801 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:23.805212 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:23.805427 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:23.805561 44881 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1228 04:22:23.805863 44881 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1228 04:22:23.806131 44881 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1228 04:22:23.811762 44881 target.go:111] Terraform output is in /tmp/test1071885179/out --- PASS: TestSharedSubnet (1.72s) === RUN TestSharedVPC I1228 04:22:23.823297 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:23.823439 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:23.823484 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:23.823561 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:23.823608 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:23.823661 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:23.823748 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:23.823781 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:23.823821 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:23.823849 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:23.848576 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:23.851796 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:23.851890 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:25.093916 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:25.282775 44881 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1228 04:22:25.288103 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:25.288137 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:25.288226 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:25.290650 44881 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1228 04:22:25.291192 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:22:25.296471 44881 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1228 04:22:25.296719 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:25.297143 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:25.297500 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:25.297656 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:25.297811 44881 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1228 04:22:25.298202 44881 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1228 04:22:25.298549 44881 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1228 04:22:25.303963 44881 target.go:111] Terraform output is in /tmp/test98604008/out --- PASS: TestSharedVPC (1.49s) === RUN TestSharedVPCIPv6 I1228 04:22:25.308472 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:25.308622 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:25.308670 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:25.308739 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:25.308786 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:25.308854 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:25.308956 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:25.308988 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:25.309040 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:25.309072 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:25.311173 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:22:25.311227 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:22:25.344170 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:22:25.344246 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1228 04:22:25.344357 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:22:25.348567 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:25.348660 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.566432 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:26.765576 44881 executor.go:111] Tasks: 0 done / 133 total; 45 can run I1228 04:22:26.766725 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:26.766781 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:26.766959 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:26.769948 44881 executor.go:111] Tasks: 45 done / 133 total; 29 can run I1228 04:22:26.770338 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:22:26.771427 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:22:26.777106 44881 executor.go:111] Tasks: 74 done / 133 total; 37 can run I1228 04:22:26.778690 44881 executor.go:111] Tasks: 111 done / 133 total; 6 can run I1228 04:22:26.778792 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:22:26.778870 44881 loadbalancers.go:35] PageSize not implemented I1228 04:22:26.778898 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:22:26.778990 44881 loadbalancers.go:35] PageSize not implemented I1228 04:22:26.785189 44881 executor.go:111] Tasks: 117 done / 133 total; 8 can run I1228 04:22:26.785748 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.786034 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.786519 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.786616 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.786698 44881 executor.go:111] Tasks: 125 done / 133 total; 2 can run I1228 04:22:26.787018 44881 executor.go:111] Tasks: 127 done / 133 total; 6 can run I1228 04:22:26.787373 44881 executor.go:111] Tasks: 133 done / 133 total; 0 can run I1228 04:22:26.793920 44881 target.go:111] Terraform output is in /tmp/test2462930009/out --- PASS: TestSharedVPCIPv6 (1.49s) === RUN TestExistingIAM I1228 04:22:26.798618 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:26.798744 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:26.798785 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:26.798832 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:26.798876 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:26.798927 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:26.799011 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:26.799044 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:26.799082 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:26.799110 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:26.832503 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:26.836024 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.836106 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.836162 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:26.836226 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.102928 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:28.295318 44881 executor.go:111] Tasks: 0 done / 117 total; 51 can run I1228 04:22:28.297705 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:28.297757 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:28.297916 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:28.300274 44881 executor.go:111] Tasks: 51 done / 117 total; 19 can run I1228 04:22:28.311089 44881 executor.go:111] Tasks: 70 done / 117 total; 31 can run I1228 04:22:28.311599 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.311854 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312094 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312342 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312430 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312558 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312626 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312810 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.312917 44881 executor.go:111] Tasks: 101 done / 117 total; 4 can run I1228 04:22:28.313351 44881 executor.go:111] Tasks: 105 done / 117 total; 12 can run I1228 04:22:28.313909 44881 executor.go:111] Tasks: 117 done / 117 total; 0 can run I1228 04:22:28.321164 44881 target.go:111] Terraform output is in /tmp/test1859468788/out --- PASS: TestExistingIAM (1.53s) === RUN TestPhaseNetwork I1228 04:22:28.326418 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:28.326553 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:28.326597 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:28.326649 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:28.326694 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:28.326748 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:28.326794 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:28.326827 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:28.326894 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:28.326925 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:28.352309 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:28.354952 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.355016 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:28.355064 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:29.786177 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:29.977174 44881 executor.go:111] Tasks: 0 done / 135 total; 47 can run I1228 04:22:29.977891 44881 executor.go:111] Tasks: 47 done / 135 total; 30 can run I1228 04:22:29.978479 44881 executor.go:111] Tasks: 77 done / 135 total; 36 can run I1228 04:22:29.979035 44881 executor.go:111] Tasks: 113 done / 135 total; 6 can run I1228 04:22:29.979225 44881 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1228 04:22:29.979395 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:22:29.979454 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:22:29.979551 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1228 04:22:29.980605 44881 target.go:111] Terraform output is in /tmp/test1144968302/out --- PASS: TestPhaseNetwork (1.65s) === RUN TestExternalLoadBalancer I1228 04:22:29.981188 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:29.981323 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:29.981369 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:29.981418 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:29.981463 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:29.981518 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:29.981606 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:29.981636 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:29.981674 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:29.981729 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:30.007686 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:30.010907 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:30.011007 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.256467 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:31.433301 44881 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1228 04:22:31.435077 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:31.435138 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:31.435263 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:31.438843 44881 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1228 04:22:31.445438 44881 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1228 04:22:31.446072 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.446355 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.446629 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.447139 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.447249 44881 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1228 04:22:31.447566 44881 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1228 04:22:31.447952 44881 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1228 04:22:31.453192 44881 target.go:111] Terraform output is in /tmp/test464058500/out --- PASS: TestExternalLoadBalancer (1.48s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I1228 04:22:31.457854 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:31.457977 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:31.458017 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:31.458060 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:31.458097 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:31.458149 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:31.458227 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:31.458256 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:31.458294 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:31.458321 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:31.495348 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:31.499115 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.499218 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.499276 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.499336 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.499392 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.499438 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:31.499491 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.750472 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:32.938712 44881 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1228 04:22:32.942127 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:32.942198 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:32.942375 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:32.948806 44881 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1228 04:22:32.954886 44881 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1228 04:22:32.955347 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.955550 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.955836 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.956061 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.956158 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.956430 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.956634 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.956719 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:32.956811 44881 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1228 04:22:32.957249 44881 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1228 04:22:32.957681 44881 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1228 04:22:32.968946 44881 target.go:111] Terraform output is in /tmp/test3972562055/out --- PASS: TestMixedInstancesASG (1.52s) === RUN TestMixedInstancesSpotASG I1228 04:22:32.975099 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:32.975331 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:32.975409 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:32.975502 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:32.975575 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:32.975676 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:32.975827 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:32.975870 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:32.975911 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:32.975959 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:33.009537 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:33.012838 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:33.012917 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:33.012969 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:33.013017 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:33.013064 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:33.013108 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:33.013151 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.292814 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:34.494102 44881 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1228 04:22:34.496016 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:34.496059 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:34.496182 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:34.503733 44881 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1228 04:22:34.510326 44881 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1228 04:22:34.510905 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.511089 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.511366 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.511611 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.511882 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.511996 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.512058 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.512473 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.512608 44881 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1228 04:22:34.513060 44881 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1228 04:22:34.513530 44881 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1228 04:22:34.520757 44881 target.go:111] Terraform output is in /tmp/test24058978/out --- PASS: TestMixedInstancesSpotASG (1.56s) === RUN TestAdditionalObjects I1228 04:22:34.531260 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:34.531493 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:34.531566 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:34.531652 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:34.531727 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:34.531780 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:34.531865 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:34.531896 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:34.531936 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:34.531965 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:34.559033 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1228 04:22:34.562329 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:34.562423 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:35.800696 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:35.982718 44881 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1228 04:22:35.984142 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:35.984190 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:35.984262 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:35.985733 44881 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1228 04:22:35.995541 44881 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1228 04:22:35.996493 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:35.996736 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:35.997133 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:35.997476 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:35.997591 44881 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1228 04:22:35.997899 44881 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1228 04:22:35.998189 44881 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1228 04:22:36.004435 44881 target.go:111] Terraform output is in /tmp/test2864039359/out --- PASS: TestAdditionalObjects (1.48s) === RUN TestContainerd I1228 04:22:36.008918 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:36.009042 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:36.009084 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:36.009129 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:36.009170 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:36.009221 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:36.009302 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:36.009332 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:36.009371 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:36.009401 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:36.034492 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:36.037613 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:36.037691 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:37.326685 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:37.510086 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:22:37.510861 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:37.510914 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:37.511016 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:37.514560 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:22:37.520298 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:22:37.520640 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:37.520943 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:37.521424 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:37.521504 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:37.521639 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:22:37.521974 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:22:37.522358 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:37.527677 44881 target.go:111] Terraform output is in /tmp/test2324925666/out --- PASS: TestContainerd (1.52s) === RUN TestContainerdCustom I1228 04:22:37.532629 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:37.532761 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:37.532803 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:37.532851 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:37.532893 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:37.532948 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:37.533029 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:37.533059 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:37.533105 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:37.533134 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:37.564500 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:37.567938 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:37.568035 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.044629 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:38.227662 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:22:38.228837 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:38.228887 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:38.228993 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:38.236382 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:22:38.242860 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:22:38.243438 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.243677 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.244014 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.244462 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.244606 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:22:38.244928 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:22:38.245332 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:38.250729 44881 target.go:111] Terraform output is in /tmp/test3743157410/out --- PASS: TestContainerdCustom (0.72s) === RUN TestDockerCustom I1228 04:22:38.255248 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:38.255373 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:38.255413 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:38.255457 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:38.255496 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:38.255544 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:38.255625 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:38.255655 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:38.255694 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:38.255732 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:38.282754 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1228 04:22:38.286059 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.286136 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.800346 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:38.980373 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:22:38.980811 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:38.980853 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:38.980943 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:38.983885 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:22:38.990186 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:22:38.990729 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.991137 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.991378 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.991879 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:38.991997 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:22:38.992323 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:22:38.992691 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:38.997958 44881 target.go:111] Terraform output is in /tmp/test1514775992/out --- PASS: TestDockerCustom (0.75s) === RUN TestAPIServerNodes I1228 04:22:39.002783 44881 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1228 04:22:39.002810 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:39.002936 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:39.002981 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:39.003027 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:39.003067 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:39.003122 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:39.003206 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:39.003236 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:39.003275 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:39.003303 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:39.035675 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1228 04:22:39.038892 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:39.038980 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:39.039040 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.512291 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:40.674258 44881 executor.go:111] Tasks: 0 done / 114 total; 47 can run I1228 04:22:40.674777 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:40.674815 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:40.674904 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:40.682652 44881 executor.go:111] Tasks: 47 done / 114 total; 28 can run I1228 04:22:40.687084 44881 executor.go:111] Tasks: 75 done / 114 total; 27 can run I1228 04:22:40.687327 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.687630 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.687712 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.687829 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.688051 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.688509 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.688614 44881 executor.go:111] Tasks: 102 done / 114 total; 3 can run I1228 04:22:40.689003 44881 executor.go:111] Tasks: 105 done / 114 total; 9 can run I1228 04:22:40.689412 44881 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1228 04:22:40.695504 44881 target.go:111] Terraform output is in /tmp/test2292631663/out I1228 04:22:40.700406 44881 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.70s) === RUN TestNTHIMDSProcessor I1228 04:22:40.700522 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:40.700661 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:40.700703 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:40.700747 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:40.700786 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:40.700845 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:40.700928 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:40.700970 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:40.701013 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:40.701044 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:40.730569 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:40.734307 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:40.734401 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:41.966297 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:42.151687 44881 executor.go:111] Tasks: 0 done / 90 total; 44 can run I1228 04:22:42.153937 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:42.153983 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:42.154125 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:42.156521 44881 executor.go:111] Tasks: 44 done / 90 total; 19 can run I1228 04:22:42.162565 44881 executor.go:111] Tasks: 63 done / 90 total; 21 can run I1228 04:22:42.162789 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:42.162935 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:42.165129 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:42.165320 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:42.165485 44881 executor.go:111] Tasks: 84 done / 90 total; 2 can run I1228 04:22:42.166099 44881 executor.go:111] Tasks: 86 done / 90 total; 4 can run I1228 04:22:42.166677 44881 executor.go:111] Tasks: 90 done / 90 total; 0 can run I1228 04:22:42.173709 44881 target.go:111] Terraform output is in /tmp/test2884905256/out --- PASS: TestNTHIMDSProcessor (1.48s) === RUN TestNTHIMDSProcessorIRSA I1228 04:22:42.177757 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:42.177895 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:42.177939 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:42.177989 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:42.178033 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:42.178094 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:42.178278 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:42.178364 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:42.178466 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:42.178532 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:42.205627 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:42.208967 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:42.209050 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:43.634144 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:43.851669 44881 executor.go:111] Tasks: 0 done / 101 total; 50 can run I1228 04:22:43.853384 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:43.853432 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:43.853592 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:43.858108 44881 executor.go:111] Tasks: 50 done / 101 total; 24 can run I1228 04:22:43.865516 44881 executor.go:111] Tasks: 74 done / 101 total; 21 can run I1228 04:22:43.865854 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:43.866314 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:43.866803 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:43.867427 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:43.867582 44881 executor.go:111] Tasks: 95 done / 101 total; 2 can run I1228 04:22:43.867984 44881 executor.go:111] Tasks: 97 done / 101 total; 4 can run I1228 04:22:43.868263 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:43.874383 44881 target.go:111] Terraform output is in /tmp/test2377558548/out --- PASS: TestNTHIMDSProcessorIRSA (1.70s) === RUN TestCustomIRSA I1228 04:22:43.879517 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:43.879650 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:43.879693 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:43.879739 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:43.879780 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:43.879834 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:43.879919 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:43.879949 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:43.879988 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:43.880015 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:43.909225 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:43.912590 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:43.912674 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:45.343196 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:46.015064 44881 executor.go:111] Tasks: 0 done / 114 total; 52 can run I1228 04:22:46.017036 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:46.017084 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:46.017188 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:46.020548 44881 executor.go:111] Tasks: 52 done / 114 total; 29 can run I1228 04:22:46.028166 44881 executor.go:111] Tasks: 81 done / 114 total; 25 can run I1228 04:22:46.028705 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:46.028987 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:46.029435 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:46.029552 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:46.029684 44881 executor.go:111] Tasks: 106 done / 114 total; 2 can run I1228 04:22:46.029989 44881 executor.go:111] Tasks: 108 done / 114 total; 6 can run I1228 04:22:46.030362 44881 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1228 04:22:46.043376 44881 target.go:111] Terraform output is in /tmp/test2307961370/out --- PASS: TestCustomIRSA (2.17s) === RUN TestClusterNameDigit I1228 04:22:46.052607 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:46.052735 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:46.052777 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:46.052823 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:46.052863 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:46.052913 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:46.053009 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:46.053040 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:46.053078 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:46.053109 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:46.081833 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:22:46.087544 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:46.087644 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.341367 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:47.532546 44881 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1228 04:22:47.534013 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:47.534045 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:47.534147 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:47.536304 44881 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1228 04:22:47.542229 44881 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1228 04:22:47.542687 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.542948 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.543449 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.543557 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.543655 44881 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1228 04:22:47.544834 44881 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1228 04:22:47.545369 44881 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1228 04:22:47.554786 44881 target.go:111] Terraform output is in /tmp/test1615429264/out --- PASS: TestClusterNameDigit (1.51s) === RUN TestCASPriorityExpander I1228 04:22:47.559915 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:47.560045 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:47.560089 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:47.560142 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:47.560215 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:47.560271 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:47.560356 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:47.560387 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:47.560440 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:47.560470 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:47.590674 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:22:47.594001 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.594087 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.594142 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:47.594197 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1228 04:22:49.504636 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:49.711953 44881 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1228 04:22:49.712333 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:49.712378 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:49.712476 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:49.715531 44881 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1228 04:22:49.726446 44881 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1228 04:22:49.726924 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.727151 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.727457 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.727905 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.728017 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.728247 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.728391 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.728763 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.728886 44881 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1228 04:22:49.729242 44881 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1228 04:22:49.729942 44881 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1228 04:22:49.736718 44881 target.go:111] Terraform output is in /tmp/test2297928819/out --- PASS: TestCASPriorityExpander (2.18s) === RUN TestCASPriorityExpanderCustom I1228 04:22:49.742009 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:49.742137 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:49.742180 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:49.742227 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:49.742267 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:49.742325 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:49.742410 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:49.742440 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:49.742479 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:49.742513 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:22:49.773770 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1228 04:22:49.777006 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.777082 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.777130 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:49.777176 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1228 04:22:51.057311 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:51.265924 44881 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1228 04:22:51.269235 44881 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1228 04:22:51.269270 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:51.269372 44881 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1228 04:22:51.273639 44881 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1228 04:22:51.280077 44881 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1228 04:22:51.280334 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.280634 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.281207 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.281352 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.281448 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.281847 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.281989 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.282121 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.282222 44881 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1228 04:22:51.282672 44881 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1228 04:22:51.283144 44881 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1228 04:22:51.299886 44881 target.go:111] Terraform output is in /tmp/test778640789/out --- PASS: TestCASPriorityExpanderCustom (1.56s) === RUN TestLifecycleMinimalAWS I1228 04:22:51.305292 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:22:51.305418 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:22:51.305461 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:22:51.305506 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:22:51.305551 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:22:51.305602 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:22:51.305643 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:22:51.305674 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:22:51.305712 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:22:51.305748 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1228 04:22:51.334408 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1228 04:22:51.338078 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:51.338243 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1228 04:22:52.642648 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:52.831642 44881 iamrole.go:89] ListRoles: { } I1228 04:22:52.833248 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:22:52.833931 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1228 04:22:52.833961 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:52.834111 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1228 04:22:52.834292 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:52.834473 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:52.834690 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:22:52.834864 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:22:52.834926 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:22:52.835051 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:22:52.835097 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:22:52.835305 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.835492 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1228 04:22:52.835540 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1228 04:22:52.835626 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:52.835653 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" }] } I1228 04:22:52.835692 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.835720 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.835868 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:22:52.835931 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:22:52.835990 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:22:52.836022 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:22:52.836066 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:22:52.837217 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:22:52.837469 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1228 04:22:52.837431 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:22:52.837532 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:22:52.837656 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:22:52.837732 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1228 04:22:52.837788 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:22:52.837905 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:22:52.837962 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:52.838042 44881 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1228 04:22:52.838174 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:22:52.838190 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I1228 04:22:52.838321 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:22:52.838374 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:22:52.838413 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:22:52.838470 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1228 04:22:52.838669 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:22:52.838769 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:22:52.838823 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:22:52.838864 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:52.839050 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.840005 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:22:52.840218 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:52.840654 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:22:52.840773 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:22:52.840275 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:22:52.841037 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:22:52.841206 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:22:52.841118 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1228 04:22:52.841313 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:22:52.841409 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1228 04:22:52.847292 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:22:52.847472 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:52.847661 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:22:52.847717 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:22:52.847793 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:52.848044 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:22:52.848185 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:52.848314 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:52.848466 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:52.848654 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:22:52.848725 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:22:52.848892 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:52.848996 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:52.849104 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.849417 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" }] }] } I1228 04:22:52.849571 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.849827 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.850072 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:22:52.850378 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.850633 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.850791 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1228 04:22:52.850935 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I1228 04:22:52.851067 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:22:52.851194 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:22:52.851324 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:22:52.851459 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" }] }] } I1228 04:22:52.851629 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:22:52.851966 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:22:52.852577 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:52.852671 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:52.852739 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:22:52.852891 44881 dns.go:235] Pre-creating DNS records I1228 04:22:52.852934 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:22:52.858955 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1228 04:22:52.862019 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:52.862107 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1228 04:22:54.347667 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:54.521301 44881 iamrole.go:89] ListRoles: { } I1228 04:22:54.522395 44881 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1228 04:22:54.522724 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.522866 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:22:54.523460 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.523924 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:22:54.523970 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:22:54.524057 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:22:54.524103 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.524434 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.525891 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:22:54.530255 44881 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1228 04:22:54.530470 44881 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1228 04:22:54.530522 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1228 04:22:54.530552 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1228 04:22:54.531183 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I1228 04:22:54.531348 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.531505 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:22:54.531561 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:22:54.531653 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:22:54.531720 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1228 04:22:54.531871 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:22:54.531944 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.532177 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:22:54.537449 44881 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1228 04:22:54.537659 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:54.537889 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:54.538130 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:54.538329 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:54.538451 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:54.538601 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:22:54.538808 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:54.539444 44881 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1228 04:22:54.539764 44881 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1228 04:22:54.540048 44881 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1228 04:22:54.542662 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:22:54.542730 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:22:54.542770 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:22:54.542802 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:22:54.542841 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:22:54.542872 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:22:54.542906 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:22:54.542940 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:22:54.542976 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:22:54.543019 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:22:54.543057 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:22:54.543090 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:22:54.543120 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:22:54.543156 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:22:54.543188 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:22:54.543224 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:22:54.543259 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:22:54.543296 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:22:54.543328 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:22:54.543361 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:22:54.543392 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:22:54.543428 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:22:54.543464 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:22:54.543522 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:22:54.544782 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:22:54.544871 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:22:54.544895 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:22:54.544938 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.544986 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1228 04:22:54.545042 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545103 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545152 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545204 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545246 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545286 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1228 04:22:54.545331 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545379 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:22:54.545419 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1228 04:22:54.545464 44881 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1228 04:22:54.545503 44881 api.go:53] PageSize not implemented I1228 04:22:54.545525 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:22:54.545551 44881 loadbalancers.go:35] PageSize not implemented I1228 04:22:54.545572 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:22:54.545603 44881 targetgroups.go:35] PageSize not implemented I1228 04:22:54.545622 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1228 04:22:54.545691 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:22:54.545737 44881 iamrole.go:89] ListRoles: { } I1228 04:22:54.545782 44881 zones.go:93] ListHostedZonesPages { } I1228 04:22:54.545810 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:22:54.545852 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:22:54.545897 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:22:54.545933 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:22:54.546473 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:22:54.546488 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:22:54.546542 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok autoscaling-group:nodes.minimal.example.com ok I1228 04:22:54.546588 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:22:54.546671 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1228 04:22:54.546588 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1228 04:22:54.546866 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:22:54.546909 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:22:54.546761 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I1228 04:22:54.546987 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1228 04:22:54.547106 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I1228 04:22:54.547216 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:22:54.547297 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1228 04:22:54.547520 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:22:54.547553 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:22:54.547618 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:22:54.547716 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1228 04:22:54.547772 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1228 04:22:54.547919 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1228 04:22:54.547989 44881 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1228 04:22:54.547971 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:22:54.548015 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:22:54.548092 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1228 04:22:54.548143 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1228 04:22:54.548205 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1228 04:22:54.548227 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:22:54.548273 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1228 04:22:54.548371 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:22:54.548479 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:22:54.548587 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.24s) === RUN TestLifecycleMinimalOpenstack I1228 04:22:54.549163 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I1228 04:22:54.557431 44881 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:22:56.027569 44881 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1228 04:22:56.027623 44881 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1228 04:22:56.046310 44881 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/12/28 04:22:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:22:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1228 04:22:56.056539 44881 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1228 04:22:56.064392 44881 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1228 04:22:56.068328 44881 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/12/28 04:22:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:22:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:22:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1228 04:22:56.075821 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1228 04:22:56.075824 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1228 04:22:56.076523 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1228 04:22:57.082004 44881 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:22:58.467477 44881 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1228 04:22:58.467524 44881 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1228 04:22:58.487266 44881 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/12/28 04:22:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:22:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1228 04:22:58.496863 44881 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1228 04:22:58.504949 44881 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1228 04:22:58.506776 44881 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/12/28 04:22:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:22:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:22:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1228 04:22:58.514607 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1228 04:22:58.515763 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1228 04:22:58.516262 44881 executor.go:111] Tasks: 92 done / 92 total; 0 can run I1228 04:22:58.517850 44881 delete_cluster.go:128] Looking for cloud resources to delete 2023/12/28 04:22:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Subnet:12278067-cae6-4f7d-89b8-7eea63642cda ok Port:6bb6c3d3-bad1-47ec-be03-62394fa381db ok SecurityGroup:0b06a6ac-d1bc-481c-a4c4-5218ff707235 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:ac1af436-e3bd-4a75-991d-223f07589f83 ok Instance:ec4dda7e-bfce-418a-821b-5e9eaa240ca5 ok Port:e00a0ce1-db69-4588-9646-cf673ff45c39 ok ServerGroup:77fae1b6-f587-4ec7-b4c1-b249e46e63cc ok Network:b78534af-aa8e-4f48-b730-84f3d7440bb1 ok Port:d9a1b340-79c1-48f0-8f4c-ccf950f8dc2f ok Instance:1a668d72-4bfc-4289-94e7-364f5f93e2d9 ok SecurityGroup:75ad8f66-6a4b-4175-932c-1c054685ec66 ok SecurityGroup:4008a2cf-ca06-428f-9959-3ad6b400a912 ok ServerGroup:1a44b045-0ecb-4ac7-98b4-66547704784f ok --- PASS: TestLifecycleMinimalOpenstack (5.08s) === RUN TestLifecycleMinimalGCE I1228 04:22:59.628679 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I1228 04:22:59.630500 44881 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:23:01.271061 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:23:01.271147 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:23:01.271263 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1228 04:23:01.271293 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1228 04:23:01.271314 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1228 04:23:01.271369 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:23:01.272650 44881 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1228 04:23:01.280868 44881 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1228 04:23:01.287271 44881 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1228 04:23:01.288162 44881 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1228 04:23:01.288371 44881 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1228 04:23:01.288462 44881 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:23:02.922356 44881 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1228 04:23:02.922466 44881 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1228 04:23:02.922591 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1228 04:23:02.922628 44881 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1228 04:23:02.922655 44881 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1228 04:23:02.922724 44881 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1228 04:23:02.924188 44881 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1228 04:23:02.928839 44881 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1228 04:23:02.934544 44881 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1228 04:23:02.935760 44881 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1228 04:23:02.935968 44881 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1228 04:23:02.937602 44881 delete_cluster.go:128] Looking for cloud resources to delete I1228 04:23:02.937685 44881 gce.go:99] Scanning zones: [us-test1-a] I1228 04:23:02.938060 44881 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I1228 04:23:02.938084 44881 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" Disk:a-etcd-main-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1703737381 ok InstanceTemplate:nodes-minimal-gce-example-com-1703737381 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.31s) === RUN TestLifecycleFloatingIPOpenstack I1228 04:23:02.939541 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I1228 04:23:02.947608 44881 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:23:04.498420 44881 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1228 04:23:04.498466 44881 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1228 04:23:04.513110 44881 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/12/28 04:23:04 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:23:04 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1228 04:23:04.519963 44881 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1228 04:23:04.530590 44881 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1228 04:23:04.534140 44881 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/12/28 04:23:04 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:23:04 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:23:04 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1228 04:23:04.536548 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1228 04:23:04.536901 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1228 04:23:05.541808 44881 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1228 04:23:07.150548 44881 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1228 04:23:07.150599 44881 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1228 04:23:07.171703 44881 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/12/28 04:23:07 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:23:07 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1228 04:23:07.181430 44881 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1228 04:23:07.187671 44881 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1228 04:23:07.189404 44881 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/12/28 04:23:07 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:23:07 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/28 04:23:07 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1228 04:23:07.192210 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1228 04:23:07.193080 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1228 04:23:07.193193 44881 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1228 04:23:07.193550 44881 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1228 04:23:07.195159 44881 delete_cluster.go:128] Looking for cloud resources to delete 2023/12/28 04:23:07 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router-IF:a2e860b3-d5d5-41ee-b1c6-c32e55347dce ok SecurityGroup:e8fb8bda-3721-4c58-99c8-ac5a7c808a27 ok SecurityGroup:ab78de7c-456d-46c7-949e-96b357c1d5bc ok Subnet:a2e860b3-d5d5-41ee-b1c6-c32e55347dce ok Router:3657f7c9-7e23-4667-9227-cd0085938400 ok SecurityGroup:30f98477-6062-49dd-b3b5-5bc84417ba0b ok ServerGroup:14420b2d-aabd-4514-a80a-516520f3df7e ok Port:13bdc6f6-b8a4-4047-a0d4-93a107a753d9 ok Instance:5dba12b1-6e67-46d8-9c80-7e3bcd39687d ok Network:49b7b8d7-2c18-4358-a15b-dffff9e1a766 ok Port:7c6b43e5-f0ca-48d9-8f5f-35d4e1bd6886 ok Instance:f2b898e5-0e45-4db0-8e4e-eaf9ad93f344 ok Instance:6622de3d-abde-4a6b-a93a-f31148f89040 ok Port:3abaed36-1c27-4b17-82d2-d3792de4a329 ok Port:c3498d32-ae32-40af-9b25-d4e6fcbdd494 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok ServerGroup:03629f53-75c6-45db-a754-2ae647543442 ok --- PASS: TestLifecycleFloatingIPOpenstack (5.37s) === RUN TestLifecyclePrivateCalico I1228 04:23:08.304705 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:08.304863 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:08.304909 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:08.304957 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:08.305001 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:08.305054 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:08.305097 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:08.305129 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:08.305169 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:08.305199 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I1228 04:23:08.334561 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:23:08.338285 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:08.338376 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:08.338437 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:09.573276 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:10.007896 44881 iamrole.go:89] ListRoles: { } I1228 04:23:10.010101 44881 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1228 04:23:10.010407 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.010579 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:10.010680 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:10.010613 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I1228 04:23:10.010720 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.010817 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:10.010894 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:10.010781 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1228 04:23:10.011001 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.011288 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.011435 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:10.011491 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:10.011604 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I1228 04:23:10.011655 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1228 04:23:10.011614 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.011958 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I1228 04:23:10.011914 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1228 04:23:10.011966 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:10.012044 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1228 04:23:10.012222 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:23:10.012302 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:23:10.012344 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:10.012405 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.012681 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:10.013750 44881 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1228 04:23:10.013917 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1228 04:23:10.013869 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.013985 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1228 04:23:10.014046 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1228 04:23:10.014117 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:10.013960 44881 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1228 04:23:10.014220 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:10.014183 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1228 04:23:10.014263 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1228 04:23:10.014376 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1228 04:23:10.014412 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1228 04:23:10.014474 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:10.014557 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1228 04:23:10.014534 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1228 04:23:10.014649 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1228 04:23:10.014642 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1228 04:23:10.014739 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1228 04:23:10.014751 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.014897 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1228 04:23:10.014916 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.015001 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:10.015052 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1228 04:23:10.015243 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1228 04:23:10.015266 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1228 04:23:10.015434 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:10.015531 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.015637 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I1228 04:23:10.015734 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.015826 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:10.015903 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:10.015989 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I1228 04:23:10.015970 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1228 04:23:10.016070 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:23:10.016100 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:10.016074 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1228 04:23:10.016182 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:10.016228 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:10.016267 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:10.016308 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:10.016355 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:10.016396 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:10.016429 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:10.016566 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:10.016555 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:10.016236 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1228 04:23:10.016644 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:23:10.016697 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:10.016773 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:10.016826 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:10.016899 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:10.016960 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:10.017001 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:10.017044 44881 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] } I1228 04:23:10.017164 44881 executor.go:111] Tasks: 79 done / 142 total; 41 can run W1228 04:23:10.017314 44881 api.go:53] PageSize not implemented I1228 04:23:10.017396 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.017480 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:10.017551 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.017615 44881 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1228 04:23:10.017686 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:10.017651 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1228 04:23:10.017726 44881 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } W1228 04:23:10.017766 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:10.017677 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.017785 44881 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1228 04:23:10.017822 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I1228 04:23:10.017914 44881 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I1228 04:23:10.018025 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:10.018081 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } W1228 04:23:10.018171 44881 api.go:53] PageSize not implemented I1228 04:23:10.018192 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:10.018174 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.018460 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1228 04:23:10.018628 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:10.018717 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:10.018788 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:10.018862 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:10.018972 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:10.019033 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" }] }] } I1228 04:23:10.019117 44881 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.019187 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I1228 04:23:10.019399 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1228 04:23:10.019467 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1228 04:23:10.019522 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:10.019662 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1228 04:23:10.019785 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } I1228 04:23:10.019942 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1228 04:23:10.020060 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1228 04:23:10.020131 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.020322 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.020482 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:10.020544 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:23:10.020594 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1228 04:23:10.020758 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1228 04:23:10.020829 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.020981 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.021137 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" }] }] } I1228 04:23:10.021297 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.021444 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:10.021562 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1228 04:23:10.021688 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1228 04:23:10.021802 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.021950 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1228 04:23:10.022100 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I1228 04:23:10.022255 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1228 04:23:10.022413 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I1228 04:23:10.022563 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.022716 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.022840 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.022925 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.023171 44881 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1228 04:23:10.023232 44881 api.go:53] PageSize not implemented I1228 04:23:10.023294 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:10.023357 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1228 04:23:10.023483 44881 api.go:53] PageSize not implemented I1228 04:23:10.023484 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:10.023539 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:10.023609 44881 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:10.023561 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:10.023728 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:10.023761 44881 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1228 04:23:10.023883 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1228 04:23:10.023834 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:10.023932 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:10.024036 44881 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1228 04:23:10.029255 44881 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1228 04:23:10.029485 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:10.029664 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I1228 04:23:10.029724 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.029823 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.029973 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.030081 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.030591 44881 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1228 04:23:10.030834 44881 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1228 04:23:10.031504 44881 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1228 04:23:10.031560 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:10.031595 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:10.031660 44881 dns.go:235] Pre-creating DNS records I1228 04:23:10.031687 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:10.038436 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:23:10.042024 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.042111 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:10.042174 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.508831 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:11.940911 44881 iamrole.go:89] ListRoles: { } I1228 04:23:11.944332 44881 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1228 04:23:11.944849 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] }] } I1228 04:23:11.946101 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:11.946353 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.946576 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:11.946650 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:11.946728 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:11.947606 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.948409 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:11.948631 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.950908 44881 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1228 04:23:11.951009 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1228 04:23:11.951150 44881 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1228 04:23:11.951152 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:11.951258 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1228 04:23:11.951223 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1228 04:23:11.951325 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1228 04:23:11.951388 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1228 04:23:11.951376 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1228 04:23:11.951297 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1228 04:23:11.951481 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:11.951539 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.951723 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:11.951772 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:11.951892 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1228 04:23:11.952048 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:11.952103 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1228 04:23:11.952265 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:11.952313 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:11.952401 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.952532 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] }] } I1228 04:23:11.952678 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.952807 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.952933 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:11.953197 44881 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1228 04:23:11.953538 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.953647 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.953617 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:11.953768 44881 api.go:53] PageSize not implemented W1228 04:23:11.953776 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:11.953816 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.953933 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.953922 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1228 04:23:11.953887 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:11.953988 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1228 04:23:11.953987 44881 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I1228 04:23:11.954028 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1228 04:23:11.954090 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1228 04:23:11.954143 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1228 04:23:11.954058 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1228 04:23:11.954230 44881 api.go:53] PageSize not implemented I1228 04:23:11.954250 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.954332 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:11.954686 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:11.954838 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:11.955004 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:11.955103 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1228 04:23:11.955257 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1228 04:23:11.955443 44881 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1228 04:23:11.955517 44881 api.go:53] PageSize not implemented I1228 04:23:11.955565 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.955575 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:11.955659 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:11.955626 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1228 04:23:11.955727 44881 api.go:53] PageSize not implemented I1228 04:23:11.955753 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:11.955729 44881 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1228 04:23:11.955827 44881 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1228 04:23:11.955782 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.955888 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.955953 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.960159 44881 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1228 04:23:11.960417 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:11.960562 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.960774 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.960960 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.961135 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:11.961860 44881 executor.go:111] Tasks: 134 done / 142 total; 2 can run W1228 04:23:11.962077 44881 api.go:53] PageSize not implemented I1228 04:23:11.962107 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.962316 44881 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1228 04:23:11.962630 44881 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1228 04:23:11.966042 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:11.966106 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:11.966146 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:11.966180 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1228 04:23:11.966217 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:11.966254 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:11.966286 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:11.966320 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:11.966357 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:11.966393 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:11.966429 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:11.966472 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1228 04:23:11.966510 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1228 04:23:11.966547 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:11.966580 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:11.966613 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:11.966651 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:11.966685 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:11.966720 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:11.966757 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:11.966792 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:11.966826 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:11.966890 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:11.966927 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:11.966961 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:11.966998 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:11.967031 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:11.967064 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:11.967101 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:11.967143 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:11.967179 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:11.968737 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:11.968806 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:11.968828 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:11.968870 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.968929 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1228 04:23:11.969009 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969075 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969124 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969176 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969219 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969263 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1228 04:23:11.969322 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969375 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:11.969404 44881 natgateway.go:117] DescribeNatGateways: { } I1228 04:23:11.969439 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1228 04:23:11.969480 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W1228 04:23:11.969533 44881 api.go:53] PageSize not implemented I1228 04:23:11.969550 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1228 04:23:11.969588 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:11.969615 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:11.969631 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1228 04:23:11.969668 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:11.969692 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:11.969709 44881 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I1228 04:23:11.969768 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:11.969807 44881 iamrole.go:89] ListRoles: { } I1228 04:23:11.969856 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:11.969887 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:11.969931 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:11.969978 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:11.970023 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1228 04:23:11.970063 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:11.970100 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I1228 04:23:11.970746 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1228 04:23:11.970808 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I1228 04:23:11.970830 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:11.970875 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1228 04:23:11.970918 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I1228 04:23:11.970893 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } autoscaling-group:nodes.privatecalico.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I1228 04:23:11.970930 44881 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I1228 04:23:11.970914 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1228 04:23:11.971074 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:11.971106 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } I1228 04:23:11.971082 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1228 04:23:11.971138 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:11.971176 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I1228 04:23:11.971169 44881 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } autoscaling-group:bastion.privatecalico.example.com ok security-group:sg-1 ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I1228 04:23:11.970965 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatecalico.example.com. ok I1228 04:23:11.971186 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1228 04:23:11.971411 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:11.971434 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:11.971478 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1228 04:23:11.971549 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:23:11.971615 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1228 04:23:11.971659 44881 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1228 04:23:11.971721 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1228 04:23:11.971777 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:11.971833 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W1228 04:23:11.972010 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:11.972038 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-config:lt-3 ok autoscaling-config:lt-2 ok volume:vol-1 ok I1228 04:23:11.972115 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1228 04:23:11.972268 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:11.972298 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I1228 04:23:11.972391 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I1228 04:23:11.972345 44881 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1228 04:23:11.972418 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1228 04:23:11.972421 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:11.972476 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I1228 04:23:11.972524 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I1228 04:23:11.972577 44881 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I1228 04:23:11.972597 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1228 04:23:11.972507 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } I1228 04:23:11.972640 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } W1228 04:23:11.972665 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:masters.privatecalico.example.com ok I1228 04:23:11.972681 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1228 04:23:11.972686 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I1228 04:23:11.972731 44881 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I1228 04:23:11.972729 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1228 04:23:11.972756 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1228 04:23:11.972796 44881 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I1228 04:23:11.972893 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1228 04:23:11.972980 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:11.973079 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:23:11.973175 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.67s) === RUN TestLifecyclePrivateKopeio I1228 04:23:11.973760 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:11.973921 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:11.973971 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:11.974011 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:11.974062 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:11.974118 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:11.974172 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:11.974202 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:11.974252 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:11.974284 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I1228 04:23:12.003966 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:12.007568 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:12.007658 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:12.007732 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.291859 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:13.485982 44881 iamrole.go:89] ListRoles: { } I1228 04:23:13.487799 44881 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1228 04:23:13.488117 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.488322 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.488495 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I1228 04:23:13.488550 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:13.488629 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1228 04:23:13.488718 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.488880 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:13.489028 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:13.489013 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I1228 04:23:13.489083 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.489154 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1228 04:23:13.489224 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1228 04:23:13.489386 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:13.489443 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:13.489512 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I1228 04:23:13.489581 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:13.489610 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1228 04:23:13.489629 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.489814 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I1228 04:23:13.489905 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:23:13.489939 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:23:13.489969 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:13.490010 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:13.490513 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:13.491077 44881 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1228 04:23:13.491286 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:13.491298 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1228 04:23:13.491413 44881 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1228 04:23:13.491458 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1228 04:23:13.491442 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.491502 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1228 04:23:13.491562 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:13.491622 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1228 04:23:13.491677 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1228 04:23:13.491781 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1228 04:23:13.491745 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1228 04:23:13.491736 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.491882 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1228 04:23:13.491912 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1228 04:23:13.491803 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1228 04:23:13.491943 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1228 04:23:13.492023 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1228 04:23:13.492013 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1228 04:23:13.492117 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:13.492112 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1228 04:23:13.492164 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.492414 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.492415 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1228 04:23:13.492579 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:13.492631 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:13.492679 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:23:13.492648 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:13.492764 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1228 04:23:13.493004 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.493123 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1228 04:23:13.493258 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1228 04:23:13.493276 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1228 04:23:13.493536 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1228 04:23:13.494244 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1228 04:23:13.494681 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.495186 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1228 04:23:13.495462 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:13.495577 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:13.495677 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.495926 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:13.496008 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:13.496152 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1228 04:23:13.496194 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:13.496290 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I1228 04:23:13.496416 44881 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1228 04:23:13.496552 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I1228 04:23:13.496720 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:13.497265 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:13.497333 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.497392 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1228 04:23:13.497421 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:13.497462 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1228 04:23:13.497521 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:13.498459 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:13.498513 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:23:13.498563 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:13.498610 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:13.498661 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:13.498784 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:13.498834 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1228 04:23:13.498889 44881 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1228 04:23:13.498967 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:13.499016 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:13.499058 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:13.499116 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:13.499164 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:13.499265 44881 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1228 04:23:13.499464 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:13.499592 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } W1228 04:23:13.499745 44881 api.go:53] PageSize not implemented I1228 04:23:13.499751 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:13.499966 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:13.499960 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1228 04:23:13.500109 44881 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1228 04:23:13.500256 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:13.500017 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:13.500328 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:13.500314 44881 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1228 04:23:13.500405 44881 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1228 04:23:13.500340 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.500504 44881 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I1228 04:23:13.500672 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:13.500742 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:13.500820 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W1228 04:23:13.500923 44881 api.go:53] PageSize not implemented I1228 04:23:13.500951 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:13.500919 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1228 04:23:13.501159 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:13.501363 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:13.501502 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1228 04:23:13.501574 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.501733 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.501919 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:13.502053 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I1228 04:23:13.502254 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:13.502332 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:13.502407 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:13.502556 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1228 04:23:13.502691 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:13.502762 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:13.502853 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.503069 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.503206 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1228 04:23:13.503346 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1228 04:23:13.503480 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I1228 04:23:13.503537 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.503625 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1228 04:23:13.503756 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.503886 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1228 04:23:13.503923 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.504044 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.504163 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.504290 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.504417 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:13.504460 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I1228 04:23:13.504548 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:13.504586 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1228 04:23:13.504625 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" }] }] } I1228 04:23:13.504792 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.504953 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.505115 44881 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1228 04:23:13.505181 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.505332 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:13.505372 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:23:13.505426 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.505559 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1228 04:23:13.505695 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1228 04:23:13.505819 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.505866 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-2" } I1228 04:23:13.505897 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I1228 04:23:13.505930 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:13.505976 44881 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1228 04:23:13.506014 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:13.506067 44881 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1228 04:23:13.506154 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:13.506206 44881 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1228 04:23:13.506252 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1228 04:23:13.506292 44881 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1228 04:23:13.506331 44881 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1228 04:23:13.506449 44881 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1228 04:23:13.506492 44881 api.go:53] PageSize not implemented I1228 04:23:13.506550 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:13.506573 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:13.506675 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1228 04:23:13.506763 44881 api.go:53] PageSize not implemented I1228 04:23:13.506786 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I1228 04:23:13.506858 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:13.506909 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:13.506919 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:13.507080 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:13.507117 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-2" } I1228 04:23:13.507280 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:13.512953 44881 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1228 04:23:13.513298 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.513457 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.513633 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.513819 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.514557 44881 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1228 04:23:13.514811 44881 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1228 04:23:13.515134 44881 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1228 04:23:13.515191 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:13.515229 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:13.515296 44881 dns.go:235] Pre-creating DNS records I1228 04:23:13.515323 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:13.522069 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:13.525601 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.525691 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:13.525752 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:14.982890 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:15.165252 44881 iamrole.go:89] ListRoles: { } I1228 04:23:15.166752 44881 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1228 04:23:15.169082 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.169198 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:15.169239 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:15.169277 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:15.169314 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.169476 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:15.170373 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.170621 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.172441 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:15.175015 44881 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1228 04:23:15.175181 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1228 04:23:15.175312 44881 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1228 04:23:15.175352 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.175491 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1228 04:23:15.175530 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.175542 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1228 04:23:15.175648 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1228 04:23:15.175661 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1228 04:23:15.175649 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.175712 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1228 04:23:15.175837 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:15.175886 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1228 04:23:15.176061 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:15.176120 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1228 04:23:15.176276 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:15.176332 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.176509 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:15.176561 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:15.176651 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.176817 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:15.176903 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.177007 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1228 04:23:15.177129 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:15.177225 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.177349 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.177443 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:15.177508 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1228 04:23:15.177554 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:15.177690 44881 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1228 04:23:15.177875 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1228 04:23:15.178075 44881 api.go:53] PageSize not implemented I1228 04:23:15.178026 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:15.178054 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:15.178175 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:15.178117 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.178205 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1228 04:23:15.178255 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.178265 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1228 04:23:15.178318 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1228 04:23:15.178277 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:15.178382 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1228 04:23:15.178317 44881 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1228 04:23:15.178425 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W1228 04:23:15.178510 44881 api.go:53] PageSize not implemented I1228 04:23:15.178533 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.178574 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:15.178673 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:15.178755 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1228 04:23:15.178928 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.179175 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1228 04:23:15.179471 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:15.179581 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.179743 44881 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1228 04:23:15.179803 44881 api.go:53] PageSize not implemented I1228 04:23:15.179839 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.179837 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:15.179925 44881 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1228 04:23:15.179952 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.179921 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1228 04:23:15.180014 44881 api.go:53] PageSize not implemented I1228 04:23:15.180028 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:15.180122 44881 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1228 04:23:15.180053 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.180084 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:15.180260 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.185674 44881 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1228 04:23:15.185878 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.186052 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.186293 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.186467 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.186983 44881 executor.go:111] Tasks: 136 done / 144 total; 2 can run W1228 04:23:15.187081 44881 api.go:53] PageSize not implemented I1228 04:23:15.187104 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.187307 44881 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1228 04:23:15.187530 44881 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1228 04:23:15.190960 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:15.191028 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:15.191070 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:15.191106 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:15.191142 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:15.191178 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:15.191211 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:15.191249 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:15.191284 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:15.191326 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:15.191370 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1228 04:23:15.191410 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:15.191444 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:15.191480 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:15.191515 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:15.191549 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:15.191587 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1228 04:23:15.191624 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:15.191660 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:15.191698 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:15.191734 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:15.191771 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:15.191809 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:15.191842 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:15.191882 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:15.191920 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1228 04:23:15.191957 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:15.191992 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:15.192025 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:15.192064 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:15.192102 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:15.192142 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:15.193797 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:15.193870 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:15.193893 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:15.193937 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.193997 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1228 04:23:15.194070 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194137 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194189 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194244 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194287 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194339 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1228 04:23:15.194406 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194488 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:15.194530 44881 natgateway.go:117] DescribeNatGateways: { } I1228 04:23:15.194568 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1228 04:23:15.194610 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W1228 04:23:15.194667 44881 api.go:53] PageSize not implemented I1228 04:23:15.194684 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1228 04:23:15.194729 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:15.194757 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:15.194775 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1228 04:23:15.194816 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:15.194841 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:15.194860 44881 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I1228 04:23:15.194923 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:15.194966 44881 iamrole.go:89] ListRoles: { } I1228 04:23:15.195014 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:15.195046 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:15.195100 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:15.195150 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:15.195203 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I1228 04:23:15.195248 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1228 04:23:15.195279 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } autoscaling-config:lt-2 ok I1228 04:23:15.195963 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } autoscaling-group:nodes.privatekopeio.example.com ok I1228 04:23:15.195980 44881 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I1228 04:23:15.196061 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I1228 04:23:15.196078 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } volume:vol-2 ok I1228 04:23:15.196080 44881 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I1228 04:23:15.196023 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } autoscaling-group:bastion.privatekopeio.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I1228 04:23:15.196148 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:15.196172 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1228 04:23:15.196236 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I1228 04:23:15.196275 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1228 04:23:15.196320 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I1228 04:23:15.196201 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } autoscaling-config:lt-1 ok W1228 04:23:15.196365 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:15.196381 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok iam-instance-profile:masters.privatekopeio.example.com ok I1228 04:23:15.196418 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:15.196238 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatekopeio.example.com. ok I1228 04:23:15.196487 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 } ] } W1228 04:23:15.196672 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:15.196690 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1228 04:23:15.196724 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-3 ok I1228 04:23:15.196793 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:23:15.196877 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1228 04:23:15.196926 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:15.197020 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1228 04:23:15.197237 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:15.197261 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1228 04:23:15.197306 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1228 04:23:15.197431 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1228 04:23:15.197486 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I1228 04:23:15.197568 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1228 04:23:15.197590 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1228 04:23:15.197499 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I1228 04:23:15.197627 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } subnet:subnet-2 ok iam-role:nodes.privatekopeio.example.com ok I1228 04:23:15.197657 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I1228 04:23:15.197710 44881 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I1228 04:23:15.197692 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1228 04:23:15.197724 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1228 04:23:15.197752 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I1228 04:23:15.197754 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:15.197786 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I1228 04:23:15.197825 44881 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1228 04:23:15.197851 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1228 04:23:15.197822 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:15.197879 44881 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I1228 04:23:15.197915 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W1228 04:23:15.198035 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:15.198054 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:15.198146 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:15.198213 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1228 04:23:15.198271 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1228 04:23:15.198348 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:23:15.198427 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (3.23s) === RUN TestLifecycleIPv6 I1228 04:23:15.198930 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:15.199073 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:15.199112 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:15.199157 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:15.199196 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:15.199246 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:15.199289 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:15.199321 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:15.199360 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:15.199389 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I1228 04:23:15.229017 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:23:15.232788 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:15.232880 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:16.465258 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:16.649879 44881 iamrole.go:89] ListRoles: { } I1228 04:23:16.654834 44881 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1228 04:23:16.655192 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I1228 04:23:16.655303 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1228 04:23:16.657065 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:16.657129 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:16.657236 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] }] } I1228 04:23:16.657524 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:16.657734 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:16.657812 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.658036 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1228 04:23:16.658193 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:16.658241 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.658400 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.658404 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I1228 04:23:16.658611 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.658796 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:16.658953 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:16.658931 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I1228 04:23:16.659018 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:23:16.659057 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:23:16.659088 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:16.659131 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:16.659048 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1228 04:23:16.660733 44881 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1228 04:23:16.660874 44881 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1228 04:23:16.660914 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:16.660930 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1228 04:23:16.661059 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1228 04:23:16.661048 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1228 04:23:16.661138 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1228 04:23:16.661322 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1228 04:23:16.661313 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1228 04:23:16.661406 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1228 04:23:16.661498 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1228 04:23:16.661546 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.661606 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1228 04:23:16.661661 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:16.661796 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:16.661822 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.662010 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1228 04:23:16.662151 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:23:16.662236 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.662211 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:16.662375 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:16.662424 44881 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I1228 04:23:16.662503 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1228 04:23:16.662617 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.662715 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:16.662788 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.662888 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:16.662981 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:16.663064 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:16.663146 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:16.663228 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1228 04:23:16.663309 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:16.663399 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:16.663450 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:16.663514 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1228 04:23:16.663119 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1228 04:23:16.663655 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:16.663747 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1228 04:23:16.663796 44881 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I1228 04:23:16.663887 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:23:16.663972 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.664073 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:16.664126 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:16.664179 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:16.664223 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:16.664272 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:16.664351 44881 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1228 04:23:16.664467 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.664625 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] }] } I1228 04:23:16.664814 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.664937 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1228 04:23:16.665121 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1228 04:23:16.665096 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.665326 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:16.665485 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:16.665588 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:16.665666 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.665812 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I1228 04:23:16.665893 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:16.665941 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1228 04:23:16.665994 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.666171 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.666323 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.666420 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:16.666564 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:16.666528 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" }] }] } I1228 04:23:16.666754 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.666917 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:16.667091 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:16.667097 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1228 04:23:16.667203 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1228 04:23:16.667221 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.667367 44881 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.667448 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.667680 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.667906 44881 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.667808 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.668068 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:16.668134 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1228 04:23:16.668309 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:16.668354 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.668522 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1228 04:23:16.668682 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I1228 04:23:16.668769 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I1228 04:23:16.668928 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1228 04:23:16.669051 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" }] }] } I1228 04:23:16.669211 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.669374 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.669545 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1228 04:23:16.669664 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1228 04:23:16.669833 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I1228 04:23:16.670024 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:16.670148 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.670362 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1228 04:23:16.670447 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1228 04:23:16.670513 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1228 04:23:16.670575 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1228 04:23:16.670636 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:16.670705 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:16.670770 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:16.670823 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:16.670895 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1228 04:23:16.670980 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1228 04:23:16.671062 44881 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1228 04:23:16.671158 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:16.671240 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:16.671261 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:16.671350 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:16.671391 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I1228 04:23:16.671443 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I1228 04:23:16.671485 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.671489 44881 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-5" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I1228 04:23:16.671588 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1228 04:23:16.671632 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1228 04:23:16.671683 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I1228 04:23:16.671768 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1228 04:23:16.671763 44881 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W1228 04:23:16.671871 44881 api.go:53] PageSize not implemented I1228 04:23:16.671861 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I1228 04:23:16.671919 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:16.672065 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I1228 04:23:16.672111 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I1228 04:23:16.672153 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.672282 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:16.672324 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:16.672386 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1228 04:23:16.672427 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:16.672497 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.672567 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I1228 04:23:16.672605 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1228 04:23:16.672638 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1228 04:23:16.672678 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I1228 04:23:16.672714 44881 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-5"] }] } I1228 04:23:16.672838 44881 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-5", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1228 04:23:16.672869 44881 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I1228 04:23:16.673074 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1228 04:23:16.673062 44881 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I1228 04:23:16.673126 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1228 04:23:16.673174 44881 tags.go:42] CreateTags { Resources: ["subnet-5"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1228 04:23:16.673234 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1228 04:23:16.673280 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1228 04:23:16.673319 44881 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I1228 04:23:16.673390 44881 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1228 04:23:16.673489 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1228 04:23:16.673473 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:16.673525 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1228 04:23:16.673571 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:16.673625 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.673640 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:16.673688 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:16.673787 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I1228 04:23:16.673779 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:16.673860 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:16.673849 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1228 04:23:16.673847 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:16.673891 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:16.673880 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:16.673962 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:16.674014 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1228 04:23:16.674063 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:16.674176 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I1228 04:23:16.679575 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:16.679766 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:16.679879 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:16.680045 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:16.680158 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:16.680690 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:16.680974 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:16.681302 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:23:16.681354 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:16.681389 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:16.681455 44881 dns.go:235] Pre-creating DNS records I1228 04:23:16.681483 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:16.688117 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1228 04:23:16.691836 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:16.691927 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:17.969745 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:18.151872 44881 iamrole.go:89] ListRoles: { } I1228 04:23:18.154021 44881 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1228 04:23:18.154481 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:18.154679 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.154831 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.155016 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.155146 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.155267 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:18.155301 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:18.155350 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:18.155760 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:18.157757 44881 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1228 04:23:18.157901 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1228 04:23:18.158066 44881 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1228 04:23:18.158059 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.158147 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1228 04:23:18.158197 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.158251 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1228 04:23:18.158352 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1228 04:23:18.158321 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:18.158396 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1228 04:23:18.158463 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:18.158542 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:18.158635 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.158778 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1228 04:23:18.158932 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:18.159002 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1228 04:23:18.159143 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:18.159186 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.159316 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.159810 44881 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1228 04:23:18.160032 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.160143 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:18.160367 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.160576 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1228 04:23:18.160786 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.160877 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:18.160919 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1228 04:23:18.161050 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:18.161180 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1228 04:23:18.161228 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1228 04:23:18.161267 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:18.161345 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.161468 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.161579 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.161716 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.161819 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.161925 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:18.161990 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1228 04:23:18.162043 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1228 04:23:18.162117 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1228 04:23:18.162159 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:18.162201 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1228 04:23:18.162239 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:18.162279 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:18.162364 44881 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1228 04:23:18.162460 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.162552 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:18.162577 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:18.162661 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:18.162685 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.162675 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:18.162727 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.162802 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.162840 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1228 04:23:18.162917 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1228 04:23:18.162975 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1228 04:23:18.162892 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W1228 04:23:18.163096 44881 api.go:53] PageSize not implemented I1228 04:23:18.163084 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:18.163168 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1228 04:23:18.163232 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:18.163316 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.163383 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:18.163479 44881 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1228 04:23:18.163552 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:18.163603 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:18.163587 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:18.163623 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.163689 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:18.163696 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.163774 44881 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1228 04:23:18.163803 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:18.163816 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:18.163866 44881 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1228 04:23:18.163788 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:18.163896 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:18.163904 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1228 04:23:18.163922 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.164094 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:18.164131 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.164199 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:18.164225 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.169276 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:18.169411 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:18.169560 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:18.169638 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:18.169802 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:18.170564 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:18.170789 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:18.171017 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:23:18.174414 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:18.174481 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:18.174524 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:18.174559 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I1228 04:23:18.174597 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1228 04:23:18.174634 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:18.174667 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1228 04:23:18.174706 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:18.174739 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:18.174774 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:18.174813 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:18.174850 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:18.174889 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:18.174932 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1228 04:23:18.174967 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1228 04:23:18.175007 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:18.175039 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:18.175072 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:18.175109 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:18.175144 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:18.175183 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1228 04:23:18.175221 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:18.175260 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:18.175297 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:18.175334 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:18.175371 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:18.175407 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:18.175445 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:18.175487 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1228 04:23:18.175528 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1228 04:23:18.175566 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1228 04:23:18.175604 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:18.175637 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:18.175671 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:18.175711 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:18.175749 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:18.175785 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:18.177847 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:18.177915 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:18.177938 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:18.177978 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178034 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1228 04:23:18.178099 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178161 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178213 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178268 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178319 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178369 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1228 04:23:18.178435 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178516 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:18.178550 44881 natgateway.go:117] DescribeNatGateways: { } I1228 04:23:18.178593 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1228 04:23:18.178637 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W1228 04:23:18.178699 44881 api.go:53] PageSize not implemented I1228 04:23:18.178719 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:18.178745 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:18.178759 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1228 04:23:18.178799 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:18.178828 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:18.178846 44881 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I1228 04:23:18.178918 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:18.178957 44881 iamrole.go:89] ListRoles: { } I1228 04:23:18.179000 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:18.179031 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:18.179077 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:18.179124 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:18.179175 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1","rtb-3"] } I1228 04:23:18.179224 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1228 04:23:18.179259 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1228 04:23:18.179292 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:18.179325 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I1228 04:23:18.179986 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I1228 04:23:18.180065 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1228 04:23:18.180072 44881 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } I1228 04:23:18.180117 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } nat-gateway:nat-2 ok iam-instance-profile:masters.minimal-ipv6.example.com ok I1228 04:23:18.180158 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1228 04:23:18.180187 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } autoscaling-config:lt-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I1228 04:23:18.180269 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } autoscaling-group:nodes.minimal-ipv6.example.com ok I1228 04:23:18.180367 44881 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I1228 04:23:18.180332 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } I1228 04:23:18.180249 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal-ipv6.example.com ok W1228 04:23:18.180482 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:18.180500 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1228 04:23:18.180476 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1228 04:23:18.180549 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1228 04:23:18.180568 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I1228 04:23:18.180622 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:18.180679 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1228 04:23:18.180973 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:18.180996 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:18.181043 44881 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I1228 04:23:18.181108 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:23:18.181172 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1228 04:23:18.181214 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1228 04:23:18.181272 44881 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1228 04:23:18.181324 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1228 04:23:18.181390 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:18.181446 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:18.181486 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1228 04:23:18.181613 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I1228 04:23:18.181663 44881 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1228 04:23:18.181680 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1228 04:23:18.181715 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I1228 04:23:18.181653 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:18.181754 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I1228 04:23:18.181814 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1228 04:23:18.181831 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1228 04:23:18.181859 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I1228 04:23:18.181840 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I1228 04:23:18.181927 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1228 04:23:18.182008 44881 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1228 04:23:18.182078 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:18.182134 44881 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I1228 04:23:18.182223 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1228 04:23:18.182275 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1228 04:23:18.182352 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:23:18.182428 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (2.98s) === RUN TestLifecycleSharedVPC I1228 04:23:18.182912 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:18.183049 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:18.183090 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:18.183134 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:18.183178 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:18.183229 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:18.183272 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:18.183303 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:18.183341 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:18.183369 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I1228 04:23:18.210298 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:18.215464 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:18.215562 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:19.437522 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:19.618842 44881 iamrole.go:89] ListRoles: { } I1228 04:23:19.620388 44881 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1228 04:23:19.620680 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:19.620780 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:19.620829 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:19.620901 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:19.620895 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I1228 04:23:19.621029 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1228 04:23:19.621067 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:19.621215 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:19.621267 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:19.621363 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:19.621398 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "sharedvpc.example.com" }] }] } I1228 04:23:19.621775 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1228 04:23:19.621850 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" }] } I1228 04:23:19.622760 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:19.623030 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:19.623194 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:19.624392 44881 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1228 04:23:19.624534 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:19.624657 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1228 04:23:19.624682 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:19.624743 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1228 04:23:19.624835 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1228 04:23:19.624881 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:19.625011 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:19.625010 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1228 04:23:19.625092 44881 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1228 04:23:19.625144 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I1228 04:23:19.625166 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:19.625306 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:19.625368 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1228 04:23:19.625391 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1228 04:23:19.625624 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1228 04:23:19.625733 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:19.625788 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:19.625840 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1228 04:23:19.626201 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:19.626293 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] } I1228 04:23:19.626383 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I1228 04:23:19.626552 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:19.626632 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:19.626738 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1228 04:23:19.631203 44881 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1228 04:23:19.631497 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" }] }] } I1228 04:23:19.631768 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" }] }] } I1228 04:23:19.632005 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1228 04:23:19.632238 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1228 04:23:19.632454 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1228 04:23:19.632672 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1228 04:23:19.632833 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:19.632952 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:19.633066 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:19.633178 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:19.633251 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:23:19.633300 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1228 04:23:19.633353 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1228 04:23:19.633538 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1228 04:23:19.633685 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I1228 04:23:19.633817 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1228 04:23:19.633866 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1228 04:23:19.633999 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1228 04:23:19.634125 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:19.634232 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:19.634375 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1228 04:23:19.634558 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:19.634702 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:19.634889 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1228 04:23:19.635203 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" }] }] } I1228 04:23:19.635476 44881 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1228 04:23:19.635811 44881 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1228 04:23:19.636151 44881 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1228 04:23:19.636233 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:19.636278 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:19.636349 44881 dns.go:235] Pre-creating DNS records I1228 04:23:19.636382 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:19.645627 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:19.648849 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:19.648949 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:20.940838 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:21.119542 44881 iamrole.go:89] ListRoles: { } I1228 04:23:21.120949 44881 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1228 04:23:21.121308 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:21.121404 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:21.121457 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:21.121525 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.121673 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.121710 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:21.122158 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:21.124287 44881 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1228 04:23:21.124505 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.124699 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:21.124771 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.124861 44881 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1228 04:23:21.124909 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1228 04:23:21.124901 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1228 04:23:21.125207 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:21.125315 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1228 04:23:21.125564 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:21.125706 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:21.129320 44881 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1228 04:23:21.129429 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:21.129583 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:21.129730 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:21.129975 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:21.130101 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:21.130422 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:21.130563 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:21.131355 44881 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1228 04:23:21.131675 44881 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1228 04:23:21.131957 44881 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1228 04:23:21.134566 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:21.134630 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:21.134667 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:21.134701 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:21.134735 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:21.134766 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:21.134802 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:21.134845 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:21.134883 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:21.134913 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:21.134943 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:21.134976 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:21.135009 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:21.135044 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:21.135078 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:21.135111 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:21.135144 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:21.135173 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:21.135204 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:21.135242 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:21.135279 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:21.136581 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:21.136641 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:21.136659 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:21.136701 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.136754 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1228 04:23:21.136808 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.136888 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.136931 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.136973 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.137014 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.137051 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1228 04:23:21.137098 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.137152 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1228 04:23:21.137185 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W1228 04:23:21.137234 44881 api.go:53] PageSize not implemented I1228 04:23:21.137255 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:21.137281 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:21.137299 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:21.137322 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:21.137342 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:21.137393 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:21.137428 44881 iamrole.go:89] ListRoles: { } I1228 04:23:21.137476 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:21.137505 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:21.137547 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:21.137586 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:21.137618 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:21.138014 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok volume:vol-2 ok autoscaling-config:lt-1 ok autoscaling-group:nodes.sharedvpc.example.com ok I1228 04:23:21.138084 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1228 04:23:21.138118 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:21.138164 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I1228 04:23:21.138209 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1228 04:23:21.138260 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I1228 04:23:21.138188 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W1228 04:23:21.138318 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:21.138344 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:21.138172 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedvpc.example.com. ok I1228 04:23:21.138384 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:21.138458 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1228 04:23:21.138672 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:21.138694 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:21.138741 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I1228 04:23:21.138826 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1228 04:23:21.138928 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I1228 04:23:21.138980 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1228 04:23:21.138998 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1228 04:23:21.138997 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:21.139034 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I1228 04:23:21.139099 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I1228 04:23:21.139152 44881 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I1228 04:23:21.139168 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1228 04:23:21.139201 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I1228 04:23:21.139275 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.96s) === RUN TestLifecycleComplex I1228 04:23:21.139741 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:21.139875 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:21.139914 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:21.139955 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:21.139992 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:21.140042 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:21.140081 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:21.140112 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:21.140153 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:21.140208 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I1228 04:23:21.181184 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:21.185321 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:21.185419 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:22.618822 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:22.809062 44881 iamrole.go:89] ListRoles: { } I1228 04:23:22.810465 44881 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1228 04:23:22.810616 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:22.810745 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.812160 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:22.812401 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:22.812493 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.812679 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1228 04:23:22.813211 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:22.813551 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:22.813699 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } W1228 04:23:22.813829 44881 api.go:53] PageSize not implemented I1228 04:23:22.813852 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.814091 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:22.814086 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.814442 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:22.815377 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:22.815569 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:22.814572 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.815730 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:23:22.815806 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:23:22.816562 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:22.816714 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:22.816982 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I1228 04:23:22.817073 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1228 04:23:22.817812 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I1228 04:23:22.817917 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1228 04:23:22.819634 44881 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1228 04:23:22.819817 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:22.819876 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:22.819947 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1228 04:23:22.819957 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.820121 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1228 04:23:22.820131 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:22.820157 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:22.820274 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:22.820309 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1228 04:23:22.820329 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:22.820446 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:22.820403 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:22.820396 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1228 04:23:22.820568 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:23:22.820518 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tcp-complex-example-com-vpjolq" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1228 04:23:22.820542 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1228 04:23:22.820659 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.820736 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:22.820903 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:22.820938 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I1228 04:23:22.821113 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:22.821190 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:22.821233 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1228 04:23:22.821359 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:22.821408 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:22.821458 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.821582 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.821696 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:22.821804 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:22.821843 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1228 04:23:22.821926 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.822074 44881 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I1228 04:23:22.822149 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:22.822325 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:22.822522 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1228 04:23:22.822313 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1228 04:23:22.822676 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1228 04:23:22.822718 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1228 04:23:22.822875 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:22.822949 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:22.823027 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:22.823078 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:22.823140 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:22.823211 44881 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I1228 04:23:22.823333 44881 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I1228 04:23:22.823390 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:23:22.823443 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1228 04:23:22.823589 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:22.823650 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1228 04:23:22.823783 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:22.823851 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:22.823928 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:22.823967 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1228 04:23:22.824125 44881 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1228 04:23:22.824347 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1228 04:23:22.824551 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1228 04:23:22.824809 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I1228 04:23:22.825055 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1228 04:23:22.825233 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:22.825382 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I1228 04:23:22.825526 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.825696 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:22.825773 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:22.825860 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:22.825938 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:22.826005 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:22.826124 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1228 04:23:22.826278 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:22.826271 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1228 04:23:22.826381 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1228 04:23:22.826537 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1228 04:23:22.826695 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:22.826738 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:23:22.826778 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I1228 04:23:22.826950 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.827103 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I1228 04:23:22.827245 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:22.827288 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I1228 04:23:22.827337 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.827482 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.827631 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.827782 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.827928 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1228 04:23:22.827968 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1228 04:23:22.828007 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1228 04:23:22.828155 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1228 04:23:22.828249 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1228 04:23:22.828391 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I1228 04:23:22.828483 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I1228 04:23:22.828579 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I1228 04:23:22.828670 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1228 04:23:22.828836 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:22.828893 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:22.828932 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1228 04:23:22.829038 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I1228 04:23:22.829127 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1228 04:23:22.829272 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:22.829313 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1228 04:23:22.829404 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1228 04:23:22.829583 44881 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1228 04:23:22.829670 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:22.829735 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:22.829693 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:22.829858 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1228 04:23:22.829842 44881 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I1228 04:23:22.829912 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I1228 04:23:22.829973 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:22.830027 44881 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1228 04:23:22.830120 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1228 04:23:22.830238 44881 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:22.830318 44881 api.go:53] PageSize not implemented I1228 04:23:22.830365 44881 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1228 04:23:22.830437 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1228 04:23:22.830442 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1228 04:23:22.830494 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:22.830522 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:22.830576 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:22.830638 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:22.830723 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:22.830745 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:22.830757 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:22.830905 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:22.836492 44881 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1228 04:23:22.836686 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:22.836797 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:22.837074 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:22.837200 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:22.838068 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:23:22.838353 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:23:22.838762 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1228 04:23:22.838820 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:22.838857 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:22.838926 44881 dns.go:235] Pre-creating DNS records I1228 04:23:22.838952 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:22.847255 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:22.851439 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:22.851535 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:24.096471 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:24.299723 44881 iamrole.go:89] ListRoles: { } I1228 04:23:24.301303 44881 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1228 04:23:24.301870 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1228 04:23:24.302844 44881 api.go:53] PageSize not implemented I1228 04:23:24.303026 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:24.303257 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.304099 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:24.305749 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:24.306138 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.307116 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:24.307244 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.307466 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1228 04:23:24.307582 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:24.307606 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:24.307647 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:24.309320 44881 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1228 04:23:24.309475 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:24.309547 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:24.309635 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:24.309610 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:24.309683 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:24.309731 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:24.309721 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:24.309823 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:24.309766 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:24.309905 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:24.309920 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:24.309988 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:24.309967 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.310146 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:24.310219 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.310360 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1228 04:23:24.310490 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:24.310589 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:24.310745 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:24.310797 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:24.310914 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:24.310979 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.311076 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.311170 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:24.311264 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:24.311633 44881 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1228 04:23:24.312041 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:24.312135 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:24.312293 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:24.312565 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:24.312694 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.312847 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:24.312889 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:24.313071 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:24.313363 44881 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1228 04:23:24.313454 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:24.313548 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:24.313483 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:24.313567 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:24.313609 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:24.313647 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:24.313689 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:24.313724 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:24.313757 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:24.313855 44881 api.go:53] PageSize not implemented I1228 04:23:24.313928 44881 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1228 04:23:24.314010 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:24.314088 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:24.314115 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:24.314201 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:24.314360 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:24.314237 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:24.314439 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:24.314412 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:24.314477 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:24.314568 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:24.314613 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:24.314653 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:24.314748 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:24.314826 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:24.320541 44881 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1228 04:23:24.320665 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:24.320825 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:24.320993 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:24.321172 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:24.321779 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:23:24.322072 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:23:24.322360 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I1228 04:23:24.328528 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:24.332006 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:24.344250 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:24.348333 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:24.348428 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:25.569618 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:25.762399 44881 iamrole.go:89] ListRoles: { } I1228 04:23:25.764408 44881 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1228 04:23:25.764613 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1228 04:23:25.764931 44881 api.go:53] PageSize not implemented I1228 04:23:25.764856 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:25.765166 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.765379 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:25.765431 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:25.765516 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.765698 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:25.765727 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:25.765823 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:25.765873 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.766020 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:25.766122 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:25.768216 44881 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1228 04:23:25.768340 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.768444 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:25.768509 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:25.768694 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:25.768590 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:25.768715 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:25.768816 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:25.768838 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:25.768905 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:25.768911 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:25.769013 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:25.769011 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:25.769104 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:25.769099 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:25.769150 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:25.769179 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:25.769337 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:25.769393 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:25.769626 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:25.769783 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.769944 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:25.769993 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.770214 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.770383 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.770543 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:25.770663 44881 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1228 04:23:25.770919 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:25.771095 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:25.771391 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:25.771543 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:25.771638 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:25.771787 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:25.771934 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:25.772333 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:25.772617 44881 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1228 04:23:25.772705 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:25.772734 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:25.772831 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:25.772862 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.772926 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.772992 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:25.773088 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:25.773151 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:25.773205 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:25.773416 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I1228 04:23:25.773462 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:25.773544 44881 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I1228 04:23:25.773601 44881 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I1228 04:23:25.773659 44881 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1228 04:23:25.773777 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1228 04:23:25.773866 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.773931 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W1228 04:23:25.773997 44881 api.go:53] PageSize not implemented I1228 04:23:25.774061 44881 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1228 04:23:25.774153 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:25.774237 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:25.774205 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:25.774273 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:25.774264 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:25.774336 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:25.774303 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.774391 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:25.774439 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.774501 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:25.774539 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:25.774613 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:25.774646 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.774782 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:25.783475 44881 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1228 04:23:25.783639 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:25.783791 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:25.783957 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:25.784139 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:25.784890 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:23:25.785145 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:23:25.785466 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1228 04:23:25.785524 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:25.785560 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:25.785630 44881 dns.go:235] Pre-creating DNS records I1228 04:23:25.794016 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:25.798661 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:25.798756 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:27.071059 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:27.269164 44881 iamrole.go:89] ListRoles: { } I1228 04:23:27.271336 44881 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1228 04:23:27.271887 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:27.272027 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1228 04:23:27.272226 44881 api.go:53] PageSize not implemented I1228 04:23:27.272258 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.272592 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:27.272712 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.272855 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:27.272888 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:27.272950 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:27.273154 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:27.273421 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:27.273409 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.274095 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:27.275882 44881 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1228 04:23:27.276018 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:27.276007 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:27.276081 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:27.276102 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:27.276223 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:27.276180 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:27.276258 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:27.276308 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:27.276347 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.276452 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:27.276541 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:27.276580 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:27.276499 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:27.276726 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:27.276806 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:27.276923 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:27.277061 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.277249 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:27.277307 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.277441 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.277590 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.277727 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:27.277821 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:27.277956 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:27.278071 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:27.278299 44881 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1228 04:23:27.278473 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:27.278571 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:27.278705 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:27.278977 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:27.279109 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.279269 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:27.279744 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:27.279928 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:27.280128 44881 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1228 04:23:27.280236 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:27.280263 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:27.280333 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:27.280351 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:27.280401 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:27.280435 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:27.280475 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:27.280509 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:27.280542 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:27.280626 44881 api.go:53] PageSize not implemented I1228 04:23:27.280674 44881 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1228 04:23:27.280720 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:27.280766 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:27.280783 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:27.280786 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:27.280868 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:27.280867 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1228 04:23:27.280899 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1228 04:23:27.280946 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:27.280962 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:27.280975 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:27.281069 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:27.281101 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:27.281177 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:27.281224 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:27.286870 44881 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1228 04:23:27.287067 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:27.287224 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:27.287346 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:27.287527 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:27.288389 44881 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1228 04:23:27.288618 44881 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1228 04:23:27.288840 44881 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I1228 04:23:27.292238 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:27.295698 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:27.308027 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:27.312085 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:27.312178 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.545111 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:28.736070 44881 iamrole.go:89] ListRoles: { } I1228 04:23:28.737577 44881 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1228 04:23:28.737812 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:28.737817 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:28.738016 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1228 04:23:28.738146 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1228 04:23:28.738259 44881 api.go:53] PageSize not implemented I1228 04:23:28.738279 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.738431 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:28.738522 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:28.738650 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I1228 04:23:28.738827 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:28.738936 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.739036 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:28.739068 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:28.739125 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:28.740485 44881 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1228 04:23:28.740631 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:28.740719 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:28.740676 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I1228 04:23:28.740762 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:28.740827 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.740962 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:28.740963 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:28.741063 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:28.741098 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:28.741113 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:28.741167 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:28.741070 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:28.742380 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:28.742442 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:28.742930 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.743126 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.743297 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:28.743546 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.743769 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:28.743957 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:28.744117 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:28.744421 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:28.744741 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:28.744822 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:28.745113 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:28.745834 44881 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1228 04:23:28.746189 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:28.746366 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:28.746437 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:28.747382 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:28.747543 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:28.747639 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:28.747843 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:28.747961 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:28.748102 44881 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1228 04:23:28.748173 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:28.748237 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:28.748343 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:28.748366 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:28.748415 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:28.748452 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:28.748498 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:28.748533 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:28.748566 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:28.748664 44881 api.go:53] PageSize not implemented I1228 04:23:28.748731 44881 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1228 04:23:28.748773 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:28.748833 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:28.748828 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:28.748848 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:28.748948 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:28.748978 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:28.749011 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:28.749081 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:28.749156 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:28.749174 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:28.749266 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:28.749297 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:28.749444 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:28.749494 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:28.755050 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:28.755179 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.755354 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.755496 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.755654 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.756755 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.756908 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.757072 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:28.757332 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:28.757563 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:23:28.757618 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:28.757655 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:28.757726 44881 dns.go:235] Pre-creating DNS records I1228 04:23:28.766789 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:28.770970 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:28.771067 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.022021 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:30.220648 44881 iamrole.go:89] ListRoles: { } I1228 04:23:30.222810 44881 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1228 04:23:30.223055 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:30.223249 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:30.223298 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.223478 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:30.223647 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:30.223690 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:30.223755 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:30.223806 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W1228 04:23:30.223924 44881 api.go:53] PageSize not implemented I1228 04:23:30.223890 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:30.224227 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:30.224357 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.224903 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1228 04:23:30.225142 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.226261 44881 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1228 04:23:30.226410 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:30.226503 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:30.226547 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:30.226491 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.226544 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:30.226673 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:30.226763 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:30.226662 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.226820 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:30.226820 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:30.226891 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:30.227125 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:30.227222 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:30.227349 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.227523 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.227704 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:30.227769 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.227925 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:30.227979 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:30.228086 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:30.228187 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:30.228376 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:30.228429 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:30.228634 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:30.228687 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:30.228943 44881 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1228 04:23:30.229239 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:30.229611 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:30.229806 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:30.229940 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:30.230067 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:30.230208 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:30.230478 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:30.230687 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:30.230874 44881 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1228 04:23:30.230985 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:30.230989 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:30.231130 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:30.231159 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:30.231222 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:30.231258 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:30.231296 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:30.231332 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:30.231365 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:30.231449 44881 api.go:53] PageSize not implemented I1228 04:23:30.231514 44881 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1228 04:23:30.231578 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:30.231654 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:30.231640 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:30.231681 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:30.231760 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:30.231795 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:30.231835 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:30.231839 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:30.231946 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:30.231921 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:30.232003 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:30.232037 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:30.232175 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:30.232225 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:30.238847 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:30.239003 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.239224 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.239322 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.239494 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.240002 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:30.240267 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:30.240531 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I1228 04:23:30.245401 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:30.248860 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.248949 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.258804 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:30.262922 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.263013 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:30.263070 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.503721 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:31.703199 44881 iamrole.go:89] ListRoles: { } I1228 04:23:31.705193 44881 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1228 04:23:31.705775 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1228 04:23:31.705949 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:31.706044 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:31.706088 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:31.706214 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1228 04:23:31.706442 44881 api.go:53] PageSize not implemented I1228 04:23:31.706393 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.706599 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.706784 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:31.706941 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.707052 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:31.707082 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:31.707138 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:31.707176 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:31.708007 44881 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1228 04:23:31.708279 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:31.708216 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.708339 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:31.708397 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:31.708467 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:31.708551 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:31.708587 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:31.708589 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:31.708662 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:31.708720 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:31.708745 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:31.708687 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:31.708895 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:31.708980 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.709126 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1228 04:23:31.709245 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.709365 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:31.709419 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:31.709570 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:31.709666 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:31.709751 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:31.709910 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:31.709970 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.710210 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:31.710273 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:31.710440 44881 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1228 04:23:31.710652 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:31.710956 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:31.711086 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:31.711256 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:31.711529 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:31.711650 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:31.711760 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:31.711897 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:31.711973 44881 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1228 04:23:31.712045 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:31.712122 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:31.712215 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:31.712245 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:31.712305 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:31.712366 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:31.712419 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:31.712469 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:31.712509 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:31.712612 44881 api.go:53] PageSize not implemented I1228 04:23:31.712693 44881 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1228 04:23:31.712758 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:31.712815 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:31.712849 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:31.712836 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:31.712959 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:31.712991 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:31.713020 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:31.713068 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:31.713159 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:31.713087 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:31.713192 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:31.713179 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:31.713357 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:31.713404 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:31.718963 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:31.719123 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.719306 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.719492 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.719671 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.720242 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:31.720555 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:31.720783 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:23:31.720827 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:31.720859 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:31.720921 44881 dns.go:235] Pre-creating DNS records I1228 04:23:31.728967 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:31.733100 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.733190 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:31.733247 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.007023 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:33.204277 44881 iamrole.go:89] ListRoles: { } I1228 04:23:33.205974 44881 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1228 04:23:33.206162 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1228 04:23:33.206342 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:33.206508 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1228 04:23:33.206633 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:33.206710 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.206845 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.206946 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:33.206992 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W1228 04:23:33.207376 44881 api.go:53] PageSize not implemented I1228 04:23:33.207433 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.207516 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:33.207540 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:33.207581 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:33.207635 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:33.209570 44881 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1228 04:23:33.209710 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:33.209836 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:33.209836 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:33.209924 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:33.210081 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:33.210057 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:33.210081 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.210181 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:33.210245 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:33.210281 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:33.210329 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:33.210411 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:33.210367 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.210454 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:33.210511 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:33.210609 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.210739 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.210880 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:33.210938 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:33.211172 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:33.211239 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.211404 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:33.211459 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:33.211598 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:33.211696 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:33.211919 44881 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1228 04:23:33.212198 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:33.212290 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:33.212755 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:33.212868 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:33.212958 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:33.213113 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:33.213233 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:33.213425 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:33.213652 44881 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1228 04:23:33.213745 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:33.213811 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:33.213758 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:33.213830 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:33.213873 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:33.213911 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:33.213951 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:33.213987 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:33.214020 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:33.214109 44881 api.go:53] PageSize not implemented I1228 04:23:33.214155 44881 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1228 04:23:33.214227 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:33.214308 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:33.214230 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:33.214416 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:33.214327 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:33.214447 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:33.214514 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:33.214533 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:33.214558 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:33.214613 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:33.214662 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:33.214688 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:33.214827 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:33.214874 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:33.220137 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:33.220308 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.220490 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.220690 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.221727 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.223040 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:33.223821 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:33.224479 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I1228 04:23:33.228931 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:33.232951 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.233043 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.233101 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.242628 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:33.246376 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.246458 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.246510 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:33.246555 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.489401 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:34.671366 44881 iamrole.go:89] ListRoles: { } I1228 04:23:34.672839 44881 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1228 04:23:34.673041 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:34.673166 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:34.673232 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.673463 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:34.673523 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.673637 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:34.673663 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:34.673725 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:34.673774 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:34.673929 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1228 04:23:34.674212 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1228 04:23:34.674615 44881 api.go:53] PageSize not implemented I1228 04:23:34.676822 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.677159 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.681603 44881 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1228 04:23:34.681857 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:34.681765 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:34.682003 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:34.681994 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:34.681934 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:34.682093 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:34.682104 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:34.682048 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:34.682248 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:34.682291 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.682353 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:34.682411 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:34.682384 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.682564 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:34.682611 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:34.682698 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:34.682837 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:34.682965 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.683116 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:34.683276 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:34.683340 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1228 04:23:34.683552 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:34.683698 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:34.683795 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.683946 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:34.684046 44881 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1228 04:23:34.684361 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:34.684574 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:34.684694 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:34.684864 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:34.684952 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:34.685141 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:34.685285 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:34.685426 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:34.685614 44881 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1228 04:23:34.685678 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:34.685779 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:34.685864 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:34.685885 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:34.685928 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:34.685964 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:34.686001 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:34.686035 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:34.686067 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:34.686159 44881 api.go:53] PageSize not implemented I1228 04:23:34.686208 44881 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1228 04:23:34.686243 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:34.686294 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:34.686317 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:34.686321 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:34.686394 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:34.686465 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:34.686457 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:34.686437 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:34.686529 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:34.686483 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:34.686697 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:34.686729 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:34.686791 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:34.686816 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:34.692617 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:34.692746 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.692957 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.693142 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.693374 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.694435 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:34.694779 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:34.695046 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:23:34.695101 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:34.695138 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:34.695205 44881 dns.go:235] Pre-creating DNS records I1228 04:23:34.703533 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1228 04:23:34.707704 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.707811 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.707875 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:34.707926 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:36.125595 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:36.330378 44881 iamrole.go:89] ListRoles: { } I1228 04:23:36.332387 44881 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1228 04:23:36.332601 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1228 04:23:36.332819 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:36.332915 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1228 04:23:36.333188 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.333393 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:36.333464 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:36.333572 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:36.333632 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.334182 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.334731 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1228 04:23:36.335460 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1228 04:23:36.335730 44881 api.go:53] PageSize not implemented I1228 04:23:36.335996 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1228 04:23:36.336379 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1228 04:23:36.338550 44881 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1228 04:23:36.338715 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:36.338865 44881 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:36.338819 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1228 04:23:36.338942 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:36.338862 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:36.338966 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:36.339032 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1228 04:23:36.339082 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1228 04:23:36.339149 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1228 04:23:36.339261 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:36.339289 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:36.339318 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:36.339358 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1228 04:23:36.339683 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:36.339781 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.340028 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:36.340112 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.340324 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.340512 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:36.340651 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1228 04:23:36.340855 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1228 04:23:36.341054 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:36.341185 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.341345 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:36.341499 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:36.341663 44881 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1228 04:23:36.341792 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:36.341933 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:36.342117 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:36.342315 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.342477 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1228 04:23:36.342628 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:36.342775 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:36.343003 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:36.343374 44881 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1228 04:23:36.343472 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:36.343466 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:36.343608 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:36.343629 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.343673 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.343710 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1228 04:23:36.343752 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1228 04:23:36.343787 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1228 04:23:36.343821 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1228 04:23:36.343918 44881 api.go:53] PageSize not implemented I1228 04:23:36.343979 44881 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1228 04:23:36.344043 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:36.344095 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:36.344059 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:36.344135 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:36.344117 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.344209 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:36.344311 44881 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1228 04:23:36.344283 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:36.344343 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:36.344365 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.344450 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:36.344484 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.344560 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1228 04:23:36.344585 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.349913 44881 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1228 04:23:36.350135 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:36.350977 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:36.351473 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:36.351723 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:36.352703 44881 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1228 04:23:36.353178 44881 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1228 04:23:36.353905 44881 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1228 04:23:36.354558 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:36.354647 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:36.354693 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:36.354729 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:36.354765 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:36.354798 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:36.354834 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:36.354871 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:36.354916 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:36.354958 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:36.354992 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:36.355025 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:36.355063 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:36.355096 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:36.355133 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:36.355170 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:36.355882 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:36.355930 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:36.355970 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:36.356008 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:36.356046 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1228 04:23:36.356084 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:36.356118 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:36.356153 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:36.356192 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:36.356231 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:36.356268 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:36.359089 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:36.359165 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:36.359189 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:36.359228 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359287 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1228 04:23:36.359355 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359417 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359467 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359529 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359594 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359641 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1228 04:23:36.359701 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359772 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1228 04:23:36.359814 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W1228 04:23:36.359869 44881 api.go:53] PageSize not implemented I1228 04:23:36.359889 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:36.359914 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:36.359930 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1228 04:23:36.359971 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:36.359995 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:36.360013 44881 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" ] } I1228 04:23:36.360082 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:36.360121 44881 iamrole.go:89] ListRoles: { } I1228 04:23:36.360183 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:36.360215 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:36.360263 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:36.360313 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:36.360359 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I1228 04:23:36.360913 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1228 04:23:36.360982 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:36.361044 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1228 04:23:36.361138 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I1228 04:23:36.361116 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1228 04:23:36.361013 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-group:master-us-test-1a.masters.complex.example.com ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.complex.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I1228 04:23:36.361225 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok autoscaling-group:nodes.complex.example.com ok I1228 04:23:36.361334 44881 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I1228 04:23:36.361355 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1228 04:23:36.361449 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I1228 04:23:36.361087 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 } ] } W1228 04:23:36.361520 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:36.361570 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I1228 04:23:36.361696 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:36.361802 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:36.361906 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:36.361970 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:36.362066 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 } ] } W1228 04:23:36.362404 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:36.362426 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:36.362459 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1228 04:23:36.362516 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok autoscaling-config:lt-1 ok I1228 04:23:36.362575 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:23:36.362635 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1228 04:23:36.362726 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I1228 04:23:36.362776 44881 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I1228 04:23:36.362792 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1228 04:23:36.362783 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1228 04:23:36.362829 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I1228 04:23:36.362890 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1228 04:23:36.362898 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I1228 04:23:36.362959 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I1228 04:23:36.362977 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1228 04:23:36.363012 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I1228 04:23:36.363115 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:36.363204 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:23:36.363280 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (15.22s) === RUN TestLifecycleExternalLB I1228 04:23:36.363795 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:36.364016 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:36.364082 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:36.364156 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:36.364229 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:36.364323 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:36.364400 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:36.364455 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:36.364522 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:36.364574 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I1228 04:23:36.390381 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:36.393624 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:36.393724 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:37.680721 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:37.853779 44881 iamrole.go:89] ListRoles: { } I1228 04:23:37.856531 44881 executor.go:111] Tasks: 0 done / 107 total; 51 can run W1228 04:23:37.856785 44881 api.go:53] PageSize not implemented I1228 04:23:37.856905 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I1228 04:23:37.856996 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:37.857045 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1228 04:23:37.857119 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:37.857161 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1228 04:23:37.857149 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:37.857244 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1228 04:23:37.857360 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1228 04:23:37.857406 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1228 04:23:37.857371 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] }] } W1228 04:23:37.857490 44881 api.go:53] PageSize not implemented I1228 04:23:37.857457 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:37.857515 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1228 04:23:37.857513 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } W1228 04:23:37.857664 44881 api.go:53] PageSize not implemented I1228 04:23:37.857574 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:37.857664 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1228 04:23:37.857647 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1228 04:23:37.857743 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:37.857760 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1228 04:23:37.857804 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:37.857984 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1228 04:23:37.858001 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:37.858207 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:37.858270 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:37.858464 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:37.858744 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.858933 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:37.859032 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:23:37.859096 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:23:37.859145 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:37.859210 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:37.859278 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1228 04:23:37.860383 44881 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1228 04:23:37.860634 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1228 04:23:37.860792 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1228 04:23:37.860787 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:37.860845 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1228 04:23:37.861011 44881 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1228 04:23:37.860887 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I1228 04:23:37.861083 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:37.861130 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1228 04:23:37.861225 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:37.861283 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1228 04:23:37.861495 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:37.861441 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1228 04:23:37.861581 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1228 04:23:37.861702 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.861812 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:37.861884 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:37.862087 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:37.862352 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1228 04:23:37.862406 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" } ] }], VpcId: "vpc-1" } I1228 04:23:37.862578 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:37.862722 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:37.862841 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:37.862928 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" }] }], VpcId: "vpc-1" } I1228 04:23:37.863101 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:37.863171 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:23:37.863230 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:23:37.863284 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:37.862962 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1228 04:23:37.863336 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:37.863419 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:37.866520 44881 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1228 04:23:37.866853 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.867043 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:37.867266 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1228 04:23:37.867434 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.867657 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.867890 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.868035 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:37.868175 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:37.868235 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:37.868375 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:37.868529 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:37.868605 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I1228 04:23:37.868846 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:37.869026 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.869283 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.869509 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.869669 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:37.869740 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.869893 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:23:37.869964 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.870126 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.870312 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.870475 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1228 04:23:37.870628 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:37.870735 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:37.871470 44881 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1228 04:23:37.871819 44881 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1228 04:23:37.872154 44881 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1228 04:23:37.872199 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:37.872234 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:37.872300 44881 dns.go:235] Pre-creating DNS records I1228 04:23:37.872331 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:37.878579 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:37.881807 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:37.881904 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:39.307448 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:39.482934 44881 iamrole.go:89] ListRoles: { } I1228 04:23:39.484564 44881 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1228 04:23:39.484974 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.485075 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1228 04:23:39.485167 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1228 04:23:39.485201 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1228 04:23:39.485515 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:39.485955 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.486137 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:39.486199 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:39.486282 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:39.486312 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:39.486388 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:39.486419 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1228 04:23:39.486672 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.486871 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1228 04:23:39.486970 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } W1228 04:23:39.487001 44881 api.go:53] PageSize not implemented I1228 04:23:39.487003 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1228 04:23:39.486863 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1228 04:23:39.487062 44881 api.go:53] PageSize not implemented W1228 04:23:39.487272 44881 api.go:53] PageSize not implemented I1228 04:23:39.487751 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:39.489389 44881 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1228 04:23:39.489502 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.489667 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:39.489769 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1228 04:23:39.489709 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1228 04:23:39.489822 44881 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1228 04:23:39.489860 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1228 04:23:39.490066 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:39.490139 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:39.490297 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:39.490378 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.490521 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.490651 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:39.495212 44881 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1228 04:23:39.495501 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:39.495601 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:39.495737 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:39.495875 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:39.496264 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:39.496407 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:39.496551 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:39.497265 44881 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1228 04:23:39.497508 44881 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1228 04:23:39.497751 44881 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1228 04:23:39.500852 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:39.500917 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:39.500958 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:39.500993 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:39.501025 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:39.501059 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:39.501091 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:39.501143 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:39.501181 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:39.501222 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:39.501256 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:39.501288 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:39.501321 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:39.501354 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:39.501385 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:39.501421 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:39.501456 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:39.501492 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:39.501525 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:39.501556 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:39.501587 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:39.501623 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:39.501663 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:39.501698 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:39.502980 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:39.503040 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:39.503061 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:39.503101 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503147 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1228 04:23:39.503200 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503257 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503305 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503360 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503401 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503439 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1228 04:23:39.503484 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503574 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1228 04:23:39.503650 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W1228 04:23:39.503705 44881 api.go:53] PageSize not implemented I1228 04:23:39.503727 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:39.503754 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:39.503770 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:39.503793 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:39.503810 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:39.503859 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:39.503898 44881 iamrole.go:89] ListRoles: { } I1228 04:23:39.503939 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:39.503967 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:39.504009 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:39.504051 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:39.504086 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:39.504512 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-group:nodes.externallb.example.com ok autoscaling-group:master-us-test-1a.masters.externallb.example.com ok volume:vol-1 ok autoscaling-config:lt-2 ok I1228 04:23:39.504692 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1228 04:23:39.504767 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I1228 04:23:39.504779 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:23:39.504840 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I1228 04:23:39.504946 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1228 04:23:39.505031 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1228 04:23:39.505098 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I1228 04:23:39.505223 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:39.505124 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I1228 04:23:39.505316 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1228 04:23:39.505567 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:39.505592 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:39.505643 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1228 04:23:39.505704 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:39.505750 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1228 04:23:39.505860 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:39.505874 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:39.505959 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I1228 04:23:39.506009 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I1228 04:23:39.505987 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:39.506026 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1228 04:23:39.506066 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I1228 04:23:39.506113 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I1228 04:23:39.506200 44881 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I1228 04:23:39.506218 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1228 04:23:39.506256 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I1228 04:23:39.506342 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:39.506426 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:23:39.506498 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (3.14s) === RUN TestLifecycleSharedSubnet I1228 04:23:39.506985 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:39.507119 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:39.507156 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:39.507197 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:39.507237 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:39.507284 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:39.507325 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:39.507357 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:39.507394 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:39.507421 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I1228 04:23:39.532652 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:39.535796 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:39.535883 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:40.965422 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:41.145635 44881 iamrole.go:89] ListRoles: { } I1228 04:23:41.146615 44881 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1228 04:23:41.146976 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:41.147197 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:41.147422 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I1228 04:23:41.147432 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:41.147524 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:41.147556 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:41.147525 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" }] } I1228 04:23:41.147622 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:41.148840 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:41.148897 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:41.148950 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:41.148974 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:41.149012 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:41.149157 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.150401 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I1228 04:23:41.150636 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1228 04:23:41.154463 44881 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1228 04:23:41.154596 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1228 04:23:41.154739 44881 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1228 04:23:41.154826 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:41.154888 44881 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] } I1228 04:23:41.154946 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1228 04:23:41.154973 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:41.155077 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1228 04:23:41.155130 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1228 04:23:41.155328 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1228 04:23:41.155361 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1228 04:23:41.155431 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1228 04:23:41.155471 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:41.155533 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:41.155576 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1228 04:23:41.155759 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1228 04:23:41.155846 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:41.155889 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:41.157217 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1228 04:23:41.161649 44881 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1228 04:23:41.161869 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.162061 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.162291 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.162512 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.162723 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.162955 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.163392 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1228 04:23:41.163609 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1228 04:23:41.163750 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.163899 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:41.163998 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:41.164229 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.164466 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1228 04:23:41.164607 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1228 04:23:41.164755 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.164892 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1228 04:23:41.165123 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:41.165217 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:41.165657 44881 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1228 04:23:41.165990 44881 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1228 04:23:41.166248 44881 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1228 04:23:41.166295 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:41.166331 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:41.166397 44881 dns.go:235] Pre-creating DNS records I1228 04:23:41.166429 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:41.172494 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:41.175674 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:41.175764 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.417697 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:42.601405 44881 iamrole.go:89] ListRoles: { } I1228 04:23:42.602748 44881 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1228 04:23:42.602983 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.603464 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:42.603615 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:42.603676 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:42.603736 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:42.604460 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.605000 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:42.606550 44881 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1228 04:23:42.606660 44881 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1228 04:23:42.606700 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1228 04:23:42.606749 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1228 04:23:42.606961 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:42.607027 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:42.607139 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1228 04:23:42.607306 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1228 04:23:42.607445 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:42.612632 44881 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1228 04:23:42.612906 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.613049 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.613158 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.613329 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.613852 44881 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1228 04:23:42.614090 44881 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1228 04:23:42.614381 44881 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1228 04:23:42.617078 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:42.617146 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:42.617181 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:42.617218 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:42.617255 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:42.617293 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:42.617332 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:42.617370 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:42.617413 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:42.617445 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:42.617479 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:42.617511 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:42.617548 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:42.617584 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:42.617622 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:42.617655 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:42.617691 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:42.617729 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:42.617768 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:42.619124 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:42.619188 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:42.619211 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:42.619255 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619310 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1228 04:23:42.619368 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619427 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619470 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619511 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619555 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619590 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1228 04:23:42.619630 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619672 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1228 04:23:42.619709 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W1228 04:23:42.619759 44881 api.go:53] PageSize not implemented I1228 04:23:42.619781 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:42.619809 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:42.619828 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:42.619853 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:42.619874 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:42.619929 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:42.619969 44881 iamrole.go:89] ListRoles: { } I1228 04:23:42.620013 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:42.620042 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:42.620092 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:42.620131 44881 routetable.go:53] DescribeRouteTables: { } autoscaling-group:nodes.sharedsubnet.example.com ok I1228 04:23:42.620525 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I1228 04:23:42.620586 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1228 04:23:42.620647 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I1228 04:23:42.620691 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } keypair:key-1 ok iam-instance-profile:nodes.sharedsubnet.example.com ok autoscaling-config:lt-2 ok I1228 04:23:42.620745 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1228 04:23:42.620747 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:42.620802 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I1228 04:23:42.620606 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I1228 04:23:42.620835 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1228 04:23:42.620979 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:42.621003 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:42.621052 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1228 04:23:42.621140 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:42.621232 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1228 04:23:42.621461 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:42.621478 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:42.621561 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I1228 04:23:42.621615 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1228 04:23:42.621634 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1228 04:23:42.621670 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok I1228 04:23:42.621701 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I1228 04:23:42.621745 44881 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1228 04:23:42.621757 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1228 04:23:42.621783 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (3.12s) === RUN TestLifecyclePrivateSharedSubnet I1228 04:23:42.622237 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:42.622375 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:42.622412 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:42.622454 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:42.622489 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:42.622537 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:42.622576 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:42.622604 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:42.622642 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:42.622677 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I1228 04:23:42.650982 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:42.655304 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.655474 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:42.655555 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:43.901192 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:44.075950 44881 iamrole.go:89] ListRoles: { } I1228 04:23:44.077381 44881 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1228 04:23:44.077753 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I1228 04:23:44.077879 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1228 04:23:44.078230 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I1228 04:23:44.078363 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1228 04:23:44.079027 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:44.079198 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.079363 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:44.079438 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:44.079471 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:44.079884 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I1228 04:23:44.079975 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:44.079977 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1228 04:23:44.080156 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:44.081688 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:44.081911 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:44.081982 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:44.082201 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:44.082440 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:44.086679 44881 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1228 04:23:44.086844 44881 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1228 04:23:44.086943 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1228 04:23:44.086896 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1228 04:23:44.087017 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1228 04:23:44.087108 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1228 04:23:44.087101 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1228 04:23:44.087193 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1228 04:23:44.087188 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1228 04:23:44.087231 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1228 04:23:44.087303 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1228 04:23:44.087382 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:44.087471 44881 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I1228 04:23:44.087576 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1228 04:23:44.087589 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1228 04:23:44.087741 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1228 04:23:44.087820 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1228 04:23:44.087859 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1228 04:23:44.087857 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1228 04:23:44.087968 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:44.088021 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:44.088069 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:44.088124 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I1228 04:23:44.088257 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:44.088315 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:44.088360 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1228 04:23:44.088482 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1228 04:23:44.088614 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:44.088695 44881 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I1228 04:23:44.088770 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I1228 04:23:44.088861 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:44.088912 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:44.088968 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1228 04:23:44.089089 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:44.089143 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:44.089436 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1228 04:23:44.089904 44881 executor.go:111] Tasks: 72 done / 123 total; 31 can run W1228 04:23:44.090264 44881 api.go:53] PageSize not implemented I1228 04:23:44.090136 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.090262 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:44.090389 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:44.090408 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:44.090501 44881 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1228 04:23:44.090566 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:44.090454 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.090547 44881 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I1228 04:23:44.090608 44881 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1228 04:23:44.090671 44881 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1228 04:23:44.090650 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" }] }] } I1228 04:23:44.090901 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.091001 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.091198 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1228 04:23:44.091354 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1228 04:23:44.091540 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1228 04:23:44.091717 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I1228 04:23:44.091881 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1228 04:23:44.092101 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.092281 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:44.092426 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1228 04:23:44.092649 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.092825 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1228 04:23:44.092942 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W1228 04:23:44.093057 44881 api.go:53] PageSize not implemented I1228 04:23:44.092894 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I1228 04:23:44.093078 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:44.093125 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1228 04:23:44.093309 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.093441 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.093696 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1228 04:23:44.093880 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.094016 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1228 04:23:44.094145 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:44.094232 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.094373 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" }] }] } I1228 04:23:44.094510 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.094638 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1228 04:23:44.094793 44881 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1228 04:23:44.094852 44881 api.go:53] PageSize not implemented I1228 04:23:44.094900 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:44.094915 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:44.095067 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W1228 04:23:44.095176 44881 api.go:53] PageSize not implemented I1228 04:23:44.095174 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:44.095242 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:44.095296 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:44.100690 44881 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1228 04:23:44.101028 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.101155 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.101293 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.101417 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.102125 44881 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1228 04:23:44.102380 44881 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1228 04:23:44.102636 44881 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1228 04:23:44.102687 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:44.102725 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:44.102792 44881 dns.go:235] Pre-creating DNS records I1228 04:23:44.102819 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:44.109290 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:44.112709 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.112794 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:44.112856 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.397029 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:45.573661 44881 iamrole.go:89] ListRoles: { } I1228 04:23:45.575483 44881 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1228 04:23:45.575697 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:45.575815 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:45.575962 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:45.576029 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:45.576102 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.576972 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I1228 04:23:45.577361 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:45.579529 44881 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1228 04:23:45.579654 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1228 04:23:45.579707 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1228 04:23:45.579768 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1228 04:23:45.579858 44881 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1228 04:23:45.579858 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1228 04:23:45.579899 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1228 04:23:45.579924 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1228 04:23:45.579818 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1228 04:23:45.580098 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:45.580215 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:45.580387 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1228 04:23:45.580633 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:45.580721 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1228 04:23:45.580947 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1228 04:23:45.581196 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:45.581270 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1228 04:23:45.581554 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:45.582215 44881 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1228 04:23:45.582530 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.582569 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:45.582679 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:45.582663 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1228 04:23:45.582628 44881 api.go:53] PageSize not implemented I1228 04:23:45.582705 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1228 04:23:45.582771 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1228 04:23:45.582742 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.582822 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1228 04:23:45.582887 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1228 04:23:45.582940 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1228 04:23:45.582839 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W1228 04:23:45.583048 44881 api.go:53] PageSize not implemented I1228 04:23:45.583080 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.583134 44881 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1228 04:23:45.583261 44881 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1228 04:23:45.583333 44881 api.go:53] PageSize not implemented I1228 04:23:45.583392 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.583403 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:45.583539 44881 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1228 04:23:45.583583 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W1228 04:23:45.583640 44881 api.go:53] PageSize not implemented I1228 04:23:45.583668 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:45.583693 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.583775 44881 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1228 04:23:45.583813 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.589272 44881 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1228 04:23:45.589489 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.589634 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.589755 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.589935 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.590688 44881 executor.go:111] Tasks: 115 done / 123 total; 2 can run W1228 04:23:45.590789 44881 api.go:53] PageSize not implemented I1228 04:23:45.590811 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.591004 44881 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1228 04:23:45.591248 44881 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1228 04:23:45.594512 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:45.594575 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:45.594610 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:45.594643 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:45.594675 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:45.594708 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:45.594745 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:45.594783 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:45.594827 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1228 04:23:45.594867 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:45.594903 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:45.594934 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:45.594969 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:45.595004 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:45.595040 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:45.595074 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:45.595111 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:45.595145 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:45.595180 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:45.595214 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:45.595252 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:45.595288 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:45.596758 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:45.596847 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:45.596871 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:45.596908 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.596967 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1228 04:23:45.597041 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597107 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597150 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597192 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597236 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597271 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1228 04:23:45.597308 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597353 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1228 04:23:45.597390 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W1228 04:23:45.597436 44881 api.go:53] PageSize not implemented I1228 04:23:45.597454 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1228 04:23:45.597493 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:45.597518 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:45.597531 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1228 04:23:45.597571 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:45.597595 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:45.597612 44881 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I1228 04:23:45.597675 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:45.597722 44881 iamrole.go:89] ListRoles: { } I1228 04:23:45.597769 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:45.597796 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:45.597842 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:45.597892 44881 routetable.go:53] DescribeRouteTables: { } autoscaling-group:bastion.private-shared-subnet.example.com ok autoscaling-group:nodes.private-shared-subnet.example.com ok I1228 04:23:45.598444 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1228 04:23:45.598508 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I1228 04:23:45.598505 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:45.598554 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1228 04:23:45.598574 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I1228 04:23:45.598639 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I1228 04:23:45.598583 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } I1228 04:23:45.598702 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1228 04:23:45.598708 44881 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok I1228 04:23:45.598770 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok W1228 04:23:45.598740 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1228 04:23:45.598654 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.private-shared-subnet.example.com ok I1228 04:23:45.598841 44881 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I1228 04:23:45.598839 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I1228 04:23:45.598963 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W1228 04:23:45.599100 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:45.599122 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:45.599170 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I1228 04:23:45.599234 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:45.599288 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1228 04:23:45.599483 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:45.599504 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1228 04:23:45.599537 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1228 04:23:45.599596 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1228 04:23:45.599641 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1228 04:23:45.599730 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I1228 04:23:45.599776 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:45.599787 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I1228 04:23:45.599875 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1228 04:23:45.599896 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1228 04:23:45.599932 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I1228 04:23:45.599857 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W1228 04:23:45.599995 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:45.600012 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:45.599972 44881 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1228 04:23:45.600066 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1228 04:23:45.600107 44881 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I1228 04:23:45.600182 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I1228 04:23:45.600270 44881 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1228 04:23:45.600289 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1228 04:23:45.600330 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.98s) === RUN TestLifecyclePrivateSharedIP I1228 04:23:45.600823 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:45.600968 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:45.601007 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:45.601051 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:45.601090 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:45.601138 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:45.601181 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:45.601212 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:45.601251 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:45.601280 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I1228 04:23:45.629748 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:45.633246 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.633333 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:45.633396 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:46.914332 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:47.088024 44881 iamrole.go:89] ListRoles: { } I1228 04:23:47.089653 44881 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1228 04:23:47.089969 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I1228 04:23:47.090105 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1228 04:23:47.090524 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:47.090645 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:47.090805 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:47.090977 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I1228 04:23:47.091066 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1228 04:23:47.091029 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:47.091209 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:47.091283 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:47.091441 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:47.091716 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:47.091781 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:47.091800 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:47.091840 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:47.091941 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.092054 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I1228 04:23:47.092174 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1228 04:23:47.093974 44881 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1228 04:23:47.094131 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:47.094267 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1228 04:23:47.094331 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1228 04:23:47.094403 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1228 04:23:47.094697 44881 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1228 04:23:47.094593 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:47.094749 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1228 04:23:47.094864 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1228 04:23:47.094967 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1228 04:23:47.095111 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1228 04:23:47.095216 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1228 04:23:47.095187 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:47.095166 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I1228 04:23:47.095369 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:47.095478 44881 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1228 04:23:47.095549 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1228 04:23:47.095674 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:47.095731 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I1228 04:23:47.095683 44881 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1228 04:23:47.096046 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:47.096167 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1228 04:23:47.096248 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1228 04:23:47.096381 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1228 04:23:47.097016 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1228 04:23:47.097125 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1228 04:23:47.097181 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1228 04:23:47.097257 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1228 04:23:47.097388 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:47.097463 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:47.097531 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:47.097593 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1228 04:23:47.097777 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:47.097853 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:47.098744 44881 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1228 04:23:47.098850 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:47.098892 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:47.098941 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:47.098979 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1228 04:23:47.099074 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1228 04:23:47.099157 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:47.099197 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:47.099243 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:47.099353 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:47.099407 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:47.099461 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:47.099500 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I1228 04:23:47.099804 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1228 04:23:47.100323 44881 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1228 04:23:47.100593 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1228 04:23:47.100753 44881 api.go:53] PageSize not implemented I1228 04:23:47.100726 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:47.100817 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:47.100743 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:47.100934 44881 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }], Type: "network" } I1228 04:23:47.100958 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:47.101033 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:47.101072 44881 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] } I1228 04:23:47.101099 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I1228 04:23:47.101170 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:47.101091 44881 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I1228 04:23:47.101223 44881 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1228 04:23:47.101294 44881 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } W1228 04:23:47.101407 44881 api.go:53] PageSize not implemented I1228 04:23:47.101432 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:47.101299 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.101589 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.101719 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.101803 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.102091 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.102303 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1228 04:23:47.102564 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:47.102690 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:47.102809 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:47.102888 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.103077 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1228 04:23:47.103206 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1228 04:23:47.103367 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1228 04:23:47.103449 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" }] }] } I1228 04:23:47.103642 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1228 04:23:47.103819 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.103963 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.104092 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.104218 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.104354 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.104477 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:47.104562 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I1228 04:23:47.104682 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.104831 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1228 04:23:47.104957 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1228 04:23:47.105044 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.105161 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.105298 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1228 04:23:47.105464 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1228 04:23:47.105506 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:47.105580 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:47.105622 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I1228 04:23:47.105752 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1228 04:23:47.105798 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:47.105888 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I1228 04:23:47.105936 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:47.105976 44881 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I1228 04:23:47.106059 44881 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1228 04:23:47.106123 44881 api.go:53] PageSize not implemented I1228 04:23:47.106164 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:47.106186 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:47.106209 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1228 04:23:47.106357 44881 api.go:53] PageSize not implemented I1228 04:23:47.106329 44881 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:47.106371 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:47.106463 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:47.106520 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:47.106688 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:47.106665 44881 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }] }] } I1228 04:23:47.106927 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1228 04:23:47.107031 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:47.107140 44881 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1228 04:23:47.112498 44881 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1228 04:23:47.112691 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:47.112859 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I1228 04:23:47.113020 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.113122 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.113334 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.113449 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.114187 44881 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1228 04:23:47.114464 44881 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1228 04:23:47.114772 44881 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1228 04:23:47.114824 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:47.114857 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:47.114928 44881 dns.go:235] Pre-creating DNS records I1228 04:23:47.114953 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:47.121354 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:47.124759 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.124852 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:47.124914 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.402743 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:48.579332 44881 iamrole.go:89] ListRoles: { } I1228 04:23:48.581373 44881 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1228 04:23:48.581801 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.582718 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.583232 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1228 04:23:48.583335 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1228 04:23:48.583387 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1228 04:23:48.583689 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:48.583782 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:48.585927 44881 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1228 04:23:48.586075 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1228 04:23:48.586277 44881 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1228 04:23:48.586233 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1228 04:23:48.586348 44881 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1228 04:23:48.586303 44881 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1228 04:23:48.586416 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1228 04:23:48.586417 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1228 04:23:48.586469 44881 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1228 04:23:48.586357 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1228 04:23:48.586663 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:48.586762 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.586993 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1228 04:23:48.587061 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1228 04:23:48.587261 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1228 04:23:48.587327 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.587455 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1228 04:23:48.587607 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:48.587658 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.587796 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.587955 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:48.588009 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:48.588190 44881 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1228 04:23:48.588433 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1228 04:23:48.588629 44881 api.go:53] PageSize not implemented I1228 04:23:48.588573 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.588592 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:48.588713 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:48.588695 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.588670 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.588737 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1228 04:23:48.588771 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.588806 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1228 04:23:48.588814 44881 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1228 04:23:48.588775 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1228 04:23:48.588845 44881 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1228 04:23:48.588886 44881 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1228 04:23:48.588888 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:48.588924 44881 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W1228 04:23:48.589001 44881 api.go:53] PageSize not implemented I1228 04:23:48.589021 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.589110 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:48.589287 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:48.589387 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1228 04:23:48.589817 44881 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1228 04:23:48.589909 44881 api.go:53] PageSize not implemented I1228 04:23:48.589911 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:48.589964 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W1228 04:23:48.590061 44881 api.go:53] PageSize not implemented I1228 04:23:48.590063 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:48.590112 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.590180 44881 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1228 04:23:48.590214 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.590008 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:48.590258 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1228 04:23:48.590424 44881 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1228 04:23:48.590458 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.595610 44881 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1228 04:23:48.595714 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:48.595884 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.596047 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.596146 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.596319 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.597102 44881 executor.go:111] Tasks: 124 done / 132 total; 2 can run W1228 04:23:48.597231 44881 api.go:53] PageSize not implemented I1228 04:23:48.597262 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.597462 44881 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1228 04:23:48.597796 44881 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1228 04:23:48.601041 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:48.601107 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:48.601146 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:48.601185 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:48.601225 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:48.601261 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:48.601301 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:48.601340 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:48.601381 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1228 04:23:48.601420 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1228 04:23:48.601457 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:48.601491 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:48.601525 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:48.601561 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:48.601594 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1228 04:23:48.601633 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:48.601669 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:48.601704 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1228 04:23:48.601739 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1228 04:23:48.601779 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:48.601817 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:48.601849 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1228 04:23:48.601886 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:48.601919 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:48.601952 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:48.601988 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:48.602026 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:48.603467 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:48.603553 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:48.603576 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:48.603617 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.603677 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1228 04:23:48.603745 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.603813 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.603857 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.603900 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.603945 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.603995 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1228 04:23:48.604051 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.604108 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:48.604138 44881 natgateway.go:117] DescribeNatGateways: { } I1228 04:23:48.604178 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1228 04:23:48.604214 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W1228 04:23:48.604262 44881 api.go:53] PageSize not implemented I1228 04:23:48.604280 44881 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1228 04:23:48.604321 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:48.604347 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:48.604361 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1228 04:23:48.604399 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:48.604423 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:48.604440 44881 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I1228 04:23:48.604500 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:48.604541 44881 iamrole.go:89] ListRoles: { } I1228 04:23:48.604589 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:48.604618 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:48.604672 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:48.604717 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:48.604753 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I1228 04:23:48.604793 44881 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1228 04:23:48.604829 44881 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1228 04:23:48.605415 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1228 04:23:48.605482 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I1228 04:23:48.605466 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1228 04:23:48.605560 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I1228 04:23:48.605615 44881 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1228 04:23:48.605634 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1228 04:23:48.605603 44881 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1228 04:23:48.605683 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } autoscaling-config:lt-3 ok iam-instance-profile:bastions.private-shared-ip.example.com ok I1228 04:23:48.605709 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } volume:vol-1 ok autoscaling-group:bastion.private-shared-ip.example.com ok I1228 04:23:48.605752 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I1228 04:23:48.605707 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } iam-instance-profile:masters.private-shared-ip.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I1228 04:23:48.605546 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-ip.example.com. ok I1228 04:23:48.605730 44881 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I1228 04:23:48.605862 44881 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } autoscaling-group:nodes.private-shared-ip.example.com ok load-balancer:api-private-shared-ip-exa-ohatqj ok I1228 04:23:48.605792 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1228 04:23:48.606007 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:48.606031 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1228 04:23:48.606067 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1228 04:23:48.606121 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:48.606173 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W1228 04:23:48.606283 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:48.606301 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:48.606332 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1228 04:23:48.606382 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W1228 04:23:48.606518 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:48.606538 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I1228 04:23:48.606632 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I1228 04:23:48.606682 44881 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1228 04:23:48.606699 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1228 04:23:48.606686 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1228 04:23:48.606737 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I1228 04:23:48.606766 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I1228 04:23:48.606771 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } subnet:subnet-2 ok I1228 04:23:48.606814 44881 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1228 04:23:48.606847 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1228 04:23:48.606823 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:48.606880 44881 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I1228 04:23:48.606909 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I1228 04:23:48.606950 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1228 04:23:48.606964 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1228 04:23:48.606899 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1228 04:23:48.606991 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok W1228 04:23:48.607010 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:48.607025 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1228 04:23:48.607102 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:48.607163 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (3.01s) === RUN TestLifecycleManyAddons I1228 04:23:48.607712 44881 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:23:48.607853 44881 internetgateways.go:66] CreateInternetGateway: { } I1228 04:23:48.607892 44881 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:23:48.607934 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:23:48.607977 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:23:48.608027 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:23:48.608071 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:23:48.608106 44881 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:23:48.608145 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:23:48.608174 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1228 04:23:48.635240 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:48.638844 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:48.638930 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:49.924699 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:50.750685 44881 iamrole.go:89] ListRoles: { } I1228 04:23:50.752136 44881 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1228 04:23:50.753327 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:50.753597 44881 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.754508 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:50.754684 44881 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:23:50.754790 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:50.755083 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:50.755285 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:50.755449 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:50.755627 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1228 04:23:50.755724 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1228 04:23:50.756136 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:50.756313 44881 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.756433 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1228 04:23:50.756463 44881 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1228 04:23:50.756493 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:50.756550 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:50.756528 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:50.756605 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I1228 04:23:50.756713 44881 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1228 04:23:50.756743 44881 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1228 04:23:50.756869 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:50.756845 44881 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1228 04:23:50.758043 44881 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1228 04:23:50.758162 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1228 04:23:50.758333 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:50.758358 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:23:50.758491 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1228 04:23:50.758526 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:50.758541 44881 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:23:50.758558 44881 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1228 04:23:50.758682 44881 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1228 04:23:50.758686 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:50.758730 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:50.758766 44881 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:23:50.758838 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:50.758878 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:50.758864 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:23:50.759032 44881 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1228 04:23:50.759076 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:50.759190 44881 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:23:50.759235 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I1228 04:23:50.759322 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:50.759364 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:50.759407 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:50.759535 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1228 04:23:50.759669 44881 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1228 04:23:50.759647 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1228 04:23:50.759979 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:50.760044 44881 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1228 04:23:50.760222 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:50.760326 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:50.760399 44881 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1228 04:23:50.760765 44881 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:23:50.764547 44881 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1228 04:23:50.764822 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:50.764937 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:50.765113 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:50.765254 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.765443 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I1228 04:23:50.765586 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:50.765730 44881 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:50.765861 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.766216 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.766419 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.767822 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:23:50.768295 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.768450 44881 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1228 04:23:50.768536 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.768759 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:50.768885 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:50.768998 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.769225 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1228 04:23:50.769464 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.769703 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I1228 04:23:50.770035 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1228 04:23:50.770429 44881 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" }] }] } I1228 04:23:50.770522 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:50.770799 44881 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" }] }] } I1228 04:23:50.771003 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1228 04:23:50.771053 44881 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1228 04:23:50.771782 44881 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1228 04:23:50.772078 44881 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1228 04:23:50.772387 44881 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1228 04:23:50.772429 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:50.772465 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:50.772527 44881 dns.go:235] Pre-creating DNS records I1228 04:23:50.772552 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:50.777292 44881 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1228 04:23:50.780018 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:50.780085 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:52.043405 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:52.847622 44881 iamrole.go:89] ListRoles: { } I1228 04:23:52.848688 44881 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1228 04:23:52.848998 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.849154 44881 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1228 04:23:52.849406 44881 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1228 04:23:52.849524 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.849764 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.849855 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:23:52.849883 44881 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:23:52.849927 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:52.850151 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.852310 44881 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1228 04:23:52.852574 44881 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1228 04:23:52.852518 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1228 04:23:52.852717 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1228 04:23:52.852844 44881 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1228 04:23:52.852938 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1228 04:23:52.852998 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I1228 04:23:52.853135 44881 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:23:52.853177 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.853307 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:52.853400 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1228 04:23:52.853564 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:52.853662 44881 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:23:52.858617 44881 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1228 04:23:52.858845 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:52.858964 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:52.859260 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:52.859464 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:52.859650 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:52.859950 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:52.860109 44881 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1228 04:23:52.860620 44881 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1228 04:23:52.860876 44881 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1228 04:23:52.861102 44881 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1228 04:23:52.864086 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1228 04:23:52.864151 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1228 04:23:52.864192 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1228 04:23:52.864229 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1228 04:23:52.864264 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1228 04:23:52.864296 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1228 04:23:52.864331 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1228 04:23:52.864364 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1228 04:23:52.864399 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1228 04:23:52.864435 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1228 04:23:52.864475 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1228 04:23:52.864508 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1228 04:23:52.864542 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1228 04:23:52.864575 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1228 04:23:52.864609 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:23:52.864640 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1228 04:23:52.864675 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:23:52.864710 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1228 04:23:52.864743 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1228 04:23:52.864776 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1228 04:23:52.864808 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1228 04:23:52.864845 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1228 04:23:52.864881 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:23:52.864916 44881 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1228 04:23:52.866576 44881 delete_cluster.go:128] Looking for cloud resources to delete W1228 04:23:52.866643 44881 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1228 04:23:52.866666 44881 keypairs.go:95] DescribeKeyPairs: { } I1228 04:23:52.866711 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.866760 44881 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1228 04:23:52.866820 44881 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.866908 44881 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.866960 44881 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.867019 44881 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.867065 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.867104 44881 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1228 04:23:52.867151 44881 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.867199 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1228 04:23:52.867239 44881 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1228 04:23:52.867285 44881 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1228 04:23:52.867327 44881 api.go:53] PageSize not implemented I1228 04:23:52.867351 44881 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1228 04:23:52.867379 44881 loadbalancers.go:35] PageSize not implemented I1228 04:23:52.867398 44881 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1228 04:23:52.867423 44881 targetgroups.go:35] PageSize not implemented I1228 04:23:52.867443 44881 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1228 04:23:52.867498 44881 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1228 04:23:52.867538 44881 iamrole.go:89] ListRoles: { } I1228 04:23:52.867586 44881 zones.go:93] ListHostedZonesPages { } I1228 04:23:52.867617 44881 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1228 04:23:52.867660 44881 internetgateways.go:101] DescribeInternetGateways: { } I1228 04:23:52.867706 44881 routetable.go:53] DescribeRouteTables: { } I1228 04:23:52.867744 44881 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1228 04:23:52.868169 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:23:52.868230 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1228 04:23:52.868226 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } iam-instance-profile:masters.minimal.example.com ok I1228 04:23:52.868316 44881 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } volume:vol-2 ok autoscaling-config:lt-1 ok keypair:key-1 ok I1228 04:23:52.868373 44881 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:23:52.868287 44881 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-group:nodes.minimal.example.com ok I1228 04:23:52.868435 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1228 04:23:52.868455 44881 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1228 04:23:52.868512 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1228 04:23:52.868754 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:52.868776 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1228 04:23:52.868813 44881 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1228 04:23:52.868876 44881 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1228 04:23:52.868923 44881 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1228 04:23:52.869003 44881 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1228 04:23:52.869102 44881 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1228 04:23:52.869233 44881 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1228 04:23:52.869251 44881 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I1228 04:23:52.869355 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1228 04:23:52.869404 44881 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1228 04:23:52.869420 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1228 04:23:52.869408 44881 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1228 04:23:52.869455 44881 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } subnet:subnet-1 ok iam-role:nodes.minimal.example.com ok I1228 04:23:52.869494 44881 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1228 04:23:52.869576 44881 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1228 04:23:52.869597 44881 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1228 04:23:52.869633 44881 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1228 04:23:52.869721 44881 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1228 04:23:52.869808 44881 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1228 04:23:52.869877 44881 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (4.26s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 214.695s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I1228 04:20:22.780424 45357 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I1228 04:20:22.802271 45359 pod.go:59] starting pod controller I1228 04:20:22.802611 45359 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/watchers 0.030s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037370} route53_test.go:93: Got zone list: [0xc0000373a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000960d0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000374d0} route53_test.go:93: Got zone list: [0xc000037500] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000960e8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000037600} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003d85d0 0xc000096108} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000377c0} route53_test.go:93: Got zone list: [0xc0000377f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096128} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037950} route53_test.go:93: Got zone list: [0xc000037980] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096150} route53_test.go:187: Successfully added resource record set: {0xc000188700 0xc000096170} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037c60} route53_test.go:93: Got zone list: [0xc000037c90] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096200} route53_test.go:199: Successfully added resource record set: {0xc000188880 0xc000096220} route53_test.go:118: Got 1 recordsets: [0xc000037e30] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037fc0} route53_test.go:93: Got zone list: [0xc000037ff0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000962c0} route53_test.go:221: Successfully added resource record set: {0xc000188a00 0xc0000962e0} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000188a00 0xc0000962e0}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e63b0} route53_test.go:93: Got zone list: [0xc0003e63e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000963a0} route53_test.go:246: Successfully removed resource set {0xc000188c00 0xc0000963c0} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e66c0} route53_test.go:93: Got zone list: [0xc0003e66f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096450} route53_test.go:264: Successfully removed resource set {0xc000188d80 0xc000096470} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e6a00} route53_test.go:93: Got zone list: [0xc0003e6a30] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096508} commontests.go:192: Successfully added resource record set: {0xc000188f00 0xc000096528} commontests.go:45: Correctly replaced resource record {0xc000188f00 0xc000096528} -> {0xc000189000 0xc000096578} commontests.go:142: Got 1 recordsets: [0xc0003e6d40] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e6f70} route53_test.go:93: Got zone list: [0xc0003e6fa0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096630} commontests.go:192: Successfully added resource record set: {0xc000189280 0xc000096650} commontests.go:70: Correctly replaced resource record {0xc000189280 0xc000096650} -> {0xc000189380 0xc0000966a0} commontests.go:142: Got 1 recordsets: [0xc0003e72b0] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e7530} route53_test.go:93: Got zone list: [0xc0003e7560] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096768} commontests.go:192: Successfully added resource record set: {0xc000189600 0xc000096788} commontests.go:142: Got 2 recordsets: [0xc0003e77d0 0xc0003e77f0] commontests.go:142: Got 2 recordsets: [0xc0003e7860 0xc0003e7880] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e7a80} route53_test.go:93: Got zone list: [0xc0003e7ab0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096890} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.012s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354400} clouddns_test.go:71: Got zone list: [0xc000037a70] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000037a10} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354500} clouddns_test.go:71: Got zone list: [0xc000037bf0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000037b90} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354600} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000353040 0xc000037d70} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc0003546c0} clouddns_test.go:71: Got zone list: [0xc000037f08] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000037ea8} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc0003547e0} clouddns_test.go:71: Got zone list: [0xc000010138] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000010108} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354920} clouddns_test.go:71: Got zone list: [0xc000010438] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000010408} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354a80} clouddns_test.go:71: Got zone list: [0xc000010a80] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000010a50} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354be0} clouddns_test.go:71: Got zone list: [0xc000010c48] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000010c18} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354d20} clouddns_test.go:71: Got zone list: [0xc000010db0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000010d80} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354e80} clouddns_test.go:71: Got zone list: [0xc000011050] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000011020} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000354fe0} clouddns_test.go:71: Got zone list: [0xc000011320] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc0000112f0} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000355160} clouddns_test.go:71: Got zone list: [0xc000011650] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc000011620} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000038f48 0xc000355340} clouddns_test.go:71: Got zone list: [0xc000011a28] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000352ec0 0xc0000119f8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.059s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.031s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.006s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.059s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I1228 04:20:31.550158 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.550395 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.550445 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.550495 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.550528 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.550597 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.550642 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.550670 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.550709 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.550743 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.562814 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.02s) === RUN TestContainerdBuilder_Docker_19_03_14 I1228 04:20:31.569779 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.569914 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.569944 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.569980 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.570015 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.570056 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.570082 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.570095 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.570125 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.570139 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.571225 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I1228 04:20:31.574653 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.574740 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.574764 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.574788 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.574807 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.574834 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.574863 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.574881 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.574899 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.574914 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.576036 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.577787 45957 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I1228 04:20:31.577808 45957 assetstore.go:111] bin/containerd I1228 04:20:31.577820 45957 assetstore.go:111] bin/containerd-shim I1228 04:20:31.577834 45957 assetstore.go:111] bin/containerd-shim-runc-v1 I1228 04:20:31.577844 45957 assetstore.go:111] bin/containerd-shim-runc-v2 I1228 04:20:31.577852 45957 assetstore.go:111] bin/containerd-stress I1228 04:20:31.577861 45957 assetstore.go:111] bin/ctr I1228 04:20:31.577921 45957 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I1228 04:20:31.577939 45957 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I1228 04:20:31.581748 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.581866 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.581906 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.581960 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.582001 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.582050 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.582092 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.582126 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.582167 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.582197 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.584038 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.586583 45957 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.01s) === RUN TestContainerdBuilder_SkipInstall I1228 04:20:31.588217 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.588382 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.588417 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.588481 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.588547 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.588622 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.588719 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.588753 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.588787 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.588826 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.590076 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.592153 45957 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I1228 04:20:31.593308 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.593448 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.593486 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.593542 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.593596 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.593660 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.593743 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.593776 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.593817 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.593847 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.595570 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.598378 45957 assetstore.go:108] Matching assets for "^docker/": I1228 04:20:31.598451 45957 assetstore.go:111] docker/containerd I1228 04:20:31.598470 45957 assetstore.go:111] docker/containerd-shim I1228 04:20:31.598487 45957 assetstore.go:111] docker/ctr I1228 04:20:31.598500 45957 assetstore.go:111] docker/docker I1228 04:20:31.598513 45957 assetstore.go:111] docker/docker-init I1228 04:20:31.598524 45957 assetstore.go:111] docker/docker-proxy I1228 04:20:31.598535 45957 assetstore.go:111] docker/dockerd I1228 04:20:31.598548 45957 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I1228 04:20:31.603872 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.604033 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.604074 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.604119 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.604159 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.604212 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.604293 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.604327 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.604367 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.604434 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.606140 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.608855 45957 assetstore.go:108] Matching assets for "^docker/": I1228 04:20:31.608886 45957 assetstore.go:111] docker/containerd I1228 04:20:31.608901 45957 assetstore.go:111] docker/containerd-shim I1228 04:20:31.608914 45957 assetstore.go:111] docker/ctr I1228 04:20:31.608928 45957 assetstore.go:111] docker/docker I1228 04:20:31.608941 45957 assetstore.go:111] docker/docker-init I1228 04:20:31.608953 45957 assetstore.go:111] docker/docker-proxy I1228 04:20:31.608965 45957 assetstore.go:111] docker/dockerd I1228 04:20:31.608977 45957 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I1228 04:20:31.613743 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.613888 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.613931 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.613989 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.614029 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.614079 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.614161 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.614195 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.614235 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.614263 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.616088 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.621162 45957 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.01s) === RUN TestDockerBuilder_HealthCheck I1228 04:20:31.621708 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.621904 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.621958 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.622060 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.622114 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.622176 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.622331 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.622396 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.622471 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.622523 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.625721 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:31.630342 45957 assetstore.go:108] Matching assets for "^docker/": I1228 04:20:31.630371 45957 assetstore.go:111] docker/docker I1228 04:20:31.630388 45957 assetstore.go:111] docker/docker-containerd I1228 04:20:31.630405 45957 assetstore.go:111] docker/docker-containerd-ctr I1228 04:20:31.630421 45957 assetstore.go:111] docker/docker-containerd-shim I1228 04:20:31.630438 45957 assetstore.go:111] docker/docker-init I1228 04:20:31.630454 45957 assetstore.go:111] docker/docker-proxy I1228 04:20:31.630470 45957 assetstore.go:111] docker/docker-runc I1228 04:20:31.630484 45957 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I1228 04:20:31.638048 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.638185 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.638229 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.638280 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.638324 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.638384 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.638438 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.638477 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.638518 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.638548 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.643842 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I1228 04:20:31.647759 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.647907 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.647950 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.648002 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.648046 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.648099 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.648145 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.648186 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.648247 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.648278 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.651562 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I1228 04:20:31.656576 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.656721 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.656774 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.656833 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.656907 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.657004 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.657055 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.657106 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.657153 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.657184 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.660519 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I1228 04:20:31.669515 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.669626 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.669660 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.669700 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.669725 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.669768 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.669801 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.669819 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.669852 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.669872 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.672021 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.02s) === RUN TestAuditConfigAPIServerBuilder I1228 04:20:31.686223 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.686321 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.686349 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.686380 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.686403 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.686433 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.686459 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.686476 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.686499 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.686515 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.688763 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I1228 04:20:31.699649 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.699847 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.699922 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.700002 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.700076 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.700156 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.700248 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.700284 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.700323 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.700352 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.703563 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.02s) === RUN TestDeddicatedAPIServerBuilder I1228 04:20:31.714793 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.714888 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.714919 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.714948 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.714974 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.715004 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.715029 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.715057 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.715090 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.715108 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.716984 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I1228 04:20:31.725375 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.725537 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.725582 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.725698 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.725983 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.726024 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.726054 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.726074 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.726098 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.726117 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.728373 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I1228 04:20:31.738538 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.738712 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.738784 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.738859 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.738927 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.739007 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.739076 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.739134 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.739200 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.739257 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.742258 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.02s) === RUN TestKubeAPIServerBuilderAMD64 I1228 04:20:31.756016 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:31.756140 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:31.756179 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:31.756220 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:31.756261 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:31.756310 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:31.756348 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:31.756379 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:31.756417 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:31.756444 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:31.759127 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.96s) === RUN TestKubeAPIServerBuilderARM64 I1228 04:20:33.713215 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:33.713352 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:33.713384 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:33.713421 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:33.713448 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:33.713481 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:33.713509 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:33.713541 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:33.713567 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:33.713586 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:33.715514 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.14s) === RUN TestKubeControllerManagerBuilder I1228 04:20:34.856275 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:34.856381 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:34.856413 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:34.856447 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:34.856473 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:34.856509 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:34.856538 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:34.856557 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:34.856582 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:34.856600 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:34.858468 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I1228 04:20:34.865061 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:34.865154 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:34.865183 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:34.865212 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:34.865237 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:34.865274 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:34.865301 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:34.865318 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:34.865341 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:34.865357 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:34.867561 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.13s) === RUN TestKubeControllerManagerBuilderARM64 I1228 04:20:35.995397 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:35.995501 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:35.995534 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:35.995567 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:35.995599 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:35.995634 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:35.995663 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:35.995682 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:35.995708 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:35.995727 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:35.997604 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.14s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I1228 04:20:37.135843 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:37.135941 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:37.135971 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:37.136006 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:37.136035 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:37.136071 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:37.136103 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:37.136121 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:37.136148 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:37.136165 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:37.138314 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.03s) === RUN TestKubeProxyBuilderAMD64 I1228 04:20:37.166108 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:37.166235 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:37.166324 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:37.166401 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:37.166468 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:37.166546 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:37.166619 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:37.166676 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:37.166741 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:37.166799 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:37.169740 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.13s) === RUN TestKubeProxyBuilderARM64 I1228 04:20:38.292291 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:38.292403 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:38.292437 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:38.292469 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:38.292498 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:38.292534 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:38.292563 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:38.292581 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:38.292614 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:38.292641 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:38.294456 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.15s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I1228 04:20:39.439151 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:39.439294 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:39.439339 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:39.439389 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:39.439426 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:39.439478 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:39.439510 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:39.439527 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:39.439596 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:39.439617 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:39.441671 45957 zones.go:93] ListHostedZonesPages { } W1228 04:20:39.447677 45957 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I1228 04:20:39.449458 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:39.449564 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:39.449599 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:39.449644 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:39.449678 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:39.449726 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:39.449774 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:39.449801 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:39.449834 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:39.449858 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:39.452608 45957 zones.go:93] ListHostedZonesPages { } W1228 04:20:40.573639 45957 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.13s) === RUN TestKubeSchedulerBuilderARM64 I1228 04:20:40.575336 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:40.575427 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:40.575456 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:40.575489 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:40.575512 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:40.575546 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:40.575572 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:40.575591 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:40.575615 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:40.575632 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:40.577328 45957 zones.go:93] ListHostedZonesPages { } W1228 04:20:41.719484 45957 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.15s) === RUN TestKubectlBuilder I1228 04:20:41.721255 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.721349 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.721379 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.721408 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.721431 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.721467 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.721496 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.721516 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.721540 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.721558 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.723245 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:41.725010 45957 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I1228 04:20:41.726987 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.727058 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.727096 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.727124 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.727146 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.727173 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.727195 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.727235 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.727256 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.727270 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.728553 45957 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.00s) === RUN Test_RunKubeletBuilderWarmPool I1228 04:20:41.732041 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.732104 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.732138 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.732162 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.732183 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.732208 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.732232 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.732254 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.732276 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.732290 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.733530 45957 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I1228 04:20:41.740174 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.740309 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.740347 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.740391 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.740429 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.740475 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.740516 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.740544 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.740581 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.740608 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.743247 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:41.745994 45957 assetstore.go:108] Matching assets for "protokube$": I1228 04:20:41.746018 45957 assetstore.go:111] /opt/kops/bin/protokube I1228 04:20:41.746048 45957 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I1228 04:20:41.746080 45957 assetstore.go:108] Matching assets for "channels$": I1228 04:20:41.746098 45957 assetstore.go:111] /opt/kops/bin/channels I1228 04:20:41.746110 45957 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I1228 04:20:41.748172 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.748267 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.748297 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.748333 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.748371 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.748415 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.748450 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.748480 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.748513 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.748539 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.751104 45957 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I1228 04:20:41.754566 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.754665 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.754698 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.754736 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.754774 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.754819 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.754856 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.754885 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.754918 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.755014 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.757549 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:41.760257 45957 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I1228 04:20:41.760835 45957 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:41.760937 45957 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:41.760966 45957 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:41.761002 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:41.761040 45957 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:41.761083 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:41.761118 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:41.761148 45957 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:41.761184 45957 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:41.761208 45957 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:41.763737 45957 zones.go:93] ListHostedZonesPages { } I1228 04:20:41.766439 45957 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.01s) PASS ok k8s.io/kops/nodeup/pkg/model 10.291s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.037s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.027s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.029s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E1228 04:20:31.489047 45961 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E1228 04:20:31.489144 45961 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.008s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I1228 04:20:31.570977 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571099 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571146 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571176 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571196 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I1228 04:20:31.571363 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571394 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571419 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571438 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571459 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571474 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571506 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571524 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571547 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571587 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571615 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571652 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571678 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571703 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571745 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571775 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571793 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571807 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1228 04:20:31.571827 45962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I1228 04:20:31.571932 45962 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I1228 04:20:31.571979 45962 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.101s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.014s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W1228 04:20:31.518815 45964 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W1228 04:20:31.522037 45964 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W1228 04:20:31.523315 45964 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W1228 04:20:31.524476 45964 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W1228 04:20:31.525548 45964 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W1228 04:20:31.526605 45964 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W1228 04:20:31.527768 45964 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E1228 04:20:31.528669 45964 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E1228 04:20:31.529005 45964 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E1228 04:20:31.529033 45964 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E1228 04:20:31.529058 45964 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.051s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.003s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.062s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.021s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.131s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.103s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.027s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.005s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.041s === RUN TestFlagToFalse I1228 04:20:39.089510 47306 featureflag_test.go:32] Created flag Unittest1 I1228 04:20:39.089593 47306 featureflag.go:164] FeatureFlag "UnitTest1"=false I1228 04:20:39.089610 47306 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I1228 04:20:39.089716 47306 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.034s === RUN TestRenderInstanceGroupZones W1228 04:20:39.110537 47308 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.027s === RUN TestWarmPoolOnlyRoll I1228 04:20:51.089798 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.089880 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.089903 47837 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I1228 04:20:51.090415 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.090444 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.091563 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.091581 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.096778 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.096826 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.096854 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.096871 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.099070 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.099755 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.099864 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.099897 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.101019 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.101041 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.106254 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.106316 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.107205 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.107285 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.107319 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.108460 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.108481 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.113684 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.113729 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.113748 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.113768 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.114733 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.115400 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.115429 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.116558 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.116584 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.121781 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.121837 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.122681 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.122714 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.123834 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.123857 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.129051 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.129109 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.129977 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.130007 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.131129 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.131159 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.136362 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.136399 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.136428 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.136446 47837 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1228 04:20:51.137316 47837 instancegroups.go:431] Draining the node: "node-2a.local". I1228 04:20:51.137795 47837 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1228 04:20:51.137822 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.138949 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.138976 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.144174 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.144224 47837 instancegroups.go:431] Draining the node: "node-2b.local". I1228 04:20:51.144797 47837 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1228 04:20:51.144821 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.145957 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.145979 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.151180 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.151245 47837 instancegroups.go:431] Draining the node: "node-2c.local". I1228 04:20:51.152182 47837 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1228 04:20:51.152218 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.153322 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.153345 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.158547 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.158575 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I1228 04:20:51.158911 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.158931 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.160045 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.160081 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.160104 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.160118 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.160138 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.161227 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.161249 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.161258 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.161272 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.162364 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.162379 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.162396 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.162405 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.162418 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.163551 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.163581 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.163590 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.163605 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.164708 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.164734 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.164742 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.164757 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.165895 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.165911 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.165932 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.165942 47837 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1228 04:20:51.165957 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.167049 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.167083 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.167093 47837 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1228 04:20:51.167109 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.168227 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1228 04:20:51.168263 47837 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1228 04:20:51.168276 47837 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1228 04:20:51.168302 47837 instancegroups.go:469] waiting for 1ms after terminating instance W1228 04:20:51.169443 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1228 04:20:51.169464 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I1228 04:20:51.169696 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.169715 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.170870 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.170909 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.170930 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.170973 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.170994 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.171014 47837 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.171032 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.171531 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.172003 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.172061 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.172087 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.173226 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.173253 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.173269 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.173291 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.173832 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.173867 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.173883 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.174999 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.175027 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.175046 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.175066 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.175086 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.175104 47837 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.175117 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.175678 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.176121 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.176149 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.177245 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.177263 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.177275 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.177293 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.177733 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.177753 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.178873 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.178901 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.178920 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.178951 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.180814 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.180936 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.182376 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.182408 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.182423 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.182438 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.182449 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.182457 47837 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.182465 47837 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1228 04:20:51.183064 47837 instancegroups.go:431] Draining the node: "node-2a.local". I1228 04:20:51.183507 47837 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1228 04:20:51.183545 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.184692 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.184724 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.184739 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.184773 47837 instancegroups.go:431] Draining the node: "node-2b.local". I1228 04:20:51.185331 47837 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1228 04:20:51.185356 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.186503 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.186526 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.186538 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.186561 47837 instancegroups.go:431] Draining the node: "node-2c.local". I1228 04:20:51.187066 47837 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1228 04:20:51.187088 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.188254 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.188293 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1228 04:20:51.188313 47837 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1228 04:20:51.188333 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I1228 04:20:51.188672 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I1228 04:20:51.188893 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.188913 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.190060 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.190083 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.195239 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.195295 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.195309 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.195317 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.195844 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.196256 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.196307 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.196327 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.197503 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.197543 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.202773 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.202821 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.203388 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.203437 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.203458 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.204594 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.204630 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.209860 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.209897 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.209910 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.209920 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.210609 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.211070 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.211094 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.212253 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.212300 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.217544 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.217615 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.218526 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.218563 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.219709 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.219752 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.224977 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.225045 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.225962 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.225999 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.227175 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.227215 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.232438 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.232479 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.232499 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.232512 47837 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1228 04:20:51.233462 47837 instancegroups.go:431] Draining the node: "node-2a.local". I1228 04:20:51.234160 47837 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1228 04:20:51.234197 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.235342 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.235366 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.240554 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.240608 47837 instancegroups.go:431] Draining the node: "node-2b.local". I1228 04:20:51.241423 47837 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1228 04:20:51.241459 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.242589 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.242610 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.247803 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.247853 47837 instancegroups.go:431] Draining the node: "node-2c.local". I1228 04:20:51.248685 47837 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1228 04:20:51.248717 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.249889 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.249910 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.255115 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.255159 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I1228 04:20:51.255330 47837 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I1228 04:20:51.255746 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.255776 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.256891 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.256921 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.256934 47837 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I1228 04:20:51.257202 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.257221 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.258347 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.258372 47837 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1228 04:20:51.258390 47837 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I1228 04:20:51.258592 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.258615 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.258632 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.258647 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I1228 04:20:51.258833 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.258854 47837 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1228 04:20:51.258868 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.258883 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I1228 04:20:51.259087 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.259112 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.260243 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.260281 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.265550 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.265622 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.265638 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.265647 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.266164 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.266596 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.266647 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.266666 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.267780 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.267807 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.267820 47837 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I1228 04:20:51.268046 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.268064 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.269218 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.269240 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.274445 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.274512 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.274536 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.274550 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.275266 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.275956 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.276020 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.276048 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.277174 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.277202 47837 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1228 04:20:51.277217 47837 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I1228 04:20:51.277473 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.277498 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.277512 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.278356 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.279411 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.279442 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.280584 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.280603 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.285823 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.285883 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.286753 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.286786 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.287907 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.287929 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.293133 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.293194 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.294069 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.294112 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.295276 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.295296 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.300486 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.300525 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I1228 04:20:51.300764 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.300782 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.300794 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.300809 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I1228 04:20:51.300948 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.300962 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.300972 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.300980 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I1228 04:20:51.301110 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.301125 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.301134 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.301142 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I1228 04:20:51.301322 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.301336 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.301346 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.302028 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.302482 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.302504 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.303644 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.303665 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.308875 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.308924 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.309653 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.309687 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.310811 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.310837 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.316055 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.316118 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.316975 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.317017 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.318127 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.318159 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.323570 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.323625 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.323652 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.323677 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.323694 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I1228 04:20:51.323983 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.324007 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.324019 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.325015 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.325706 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.325734 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.326909 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.326951 47837 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1228 04:20:51.326973 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.326992 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I1228 04:20:51.327198 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.327225 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.327239 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.328288 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.329053 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.329085 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.330216 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.330239 47837 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1228 04:20:51.330253 47837 instancegroups.go:509] Cluster did not validate within 0s E1228 04:20:51.330263 47837 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I1228 04:20:51.330473 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.330492 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.331616 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.331655 47837 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1228 04:20:51.332802 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.338001 47837 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1228 04:20:51.339153 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.344375 47837 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1228 04:20:51.345526 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.350746 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.350824 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.350843 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.350855 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.351414 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.351847 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.351904 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.351924 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.353050 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.353081 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.358285 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.358350 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.358951 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.359007 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.359026 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.360149 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.360207 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.365447 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.365487 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.365505 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.365515 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.366183 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.366683 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.366707 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.367826 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.367861 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.373811 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.373891 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.374628 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.374655 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.375809 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.375840 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.381069 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.381134 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.381789 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.381813 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.382944 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.382987 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.388238 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.388287 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.388314 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.388331 47837 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1228 04:20:51.389300 47837 instancegroups.go:431] Draining the node: "node-2a.local". I1228 04:20:51.390007 47837 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1228 04:20:51.390040 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.391179 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.391240 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.396455 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.396528 47837 instancegroups.go:431] Draining the node: "node-2b.local". I1228 04:20:51.397237 47837 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1228 04:20:51.397263 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.398399 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.398443 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.403669 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.403744 47837 instancegroups.go:431] Draining the node: "node-2c.local". I1228 04:20:51.404730 47837 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1228 04:20:51.404762 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.405886 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.405923 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.411150 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.411193 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I1228 04:20:51.411506 47837 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1228 04:20:51.411529 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.412642 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.412674 47837 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1228 04:20:51.413829 47837 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1228 04:20:51.414945 47837 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1228 04:20:51.416046 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.421267 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.421360 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.421388 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.421410 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.422195 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.422900 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.422977 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.423012 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.424119 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.424152 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.429361 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.429441 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.430303 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.430374 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.430406 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.431564 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.431612 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.436821 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.436882 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.436899 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.436910 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.437652 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.438392 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.438433 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.439598 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.439651 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.444895 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.444966 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.445610 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.445643 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.446792 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.446815 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.452008 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.452075 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.452883 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.452914 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.454092 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.454135 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.459338 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.459375 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.459395 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.459410 47837 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1228 04:20:51.460301 47837 instancegroups.go:431] Draining the node: "node-2a.local". I1228 04:20:51.460982 47837 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1228 04:20:51.461013 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.462183 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.462220 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.467412 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.467470 47837 instancegroups.go:431] Draining the node: "node-2b.local". I1228 04:20:51.468249 47837 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1228 04:20:51.468281 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.469437 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.469466 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.474630 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.474683 47837 instancegroups.go:431] Draining the node: "node-2c.local". I1228 04:20:51.475330 47837 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1228 04:20:51.475356 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.476492 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.476538 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.481749 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.481799 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I1228 04:20:51.482330 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.482346 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.482354 47837 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1228 04:20:51.482877 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.483343 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.483365 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.484500 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.484536 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.489772 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.489825 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.490481 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.490506 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.491640 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.491672 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.496902 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.496939 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I1228 04:20:51.497193 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.497210 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.497218 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.497723 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.498148 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.498198 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.498216 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.499355 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.499390 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.504631 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.504684 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.505244 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.505298 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.505317 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.506454 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.506487 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.511681 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.511714 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I1228 04:20:51.511988 47837 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W1228 04:20:51.512012 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1228 04:20:51.512024 47837 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W1228 04:20:51.512033 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1228 04:20:51.512047 47837 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W1228 04:20:51.512056 47837 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1228 04:20:51.512068 47837 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1228 04:20:51.512078 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I1228 04:20:51.512213 47837 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I1228 04:20:51.512247 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:51.513375 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.513409 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.518606 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.518639 47837 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I1228 04:20:51.518679 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.518694 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.518703 47837 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1228 04:20:51.519298 47837 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I1228 04:20:51.519327 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.519340 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.519355 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:51.520086 47837 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1228 04:20:51.520139 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:51.521292 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.521329 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.526566 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.526607 47837 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I1228 04:20:51.526627 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.526648 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.526664 47837 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1228 04:20:51.527726 47837 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I1228 04:20:51.527791 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:51.528936 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.529289 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:51.534560 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.534590 47837 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1228 04:20:51.534606 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I1228 04:20:51.534846 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.534867 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.534877 47837 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1228 04:20:51.536110 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.536592 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.536621 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.541340 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.541393 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.541437 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.541509 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.545261 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.545575 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.545622 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.546740 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.546811 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.647212 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.647348 47837 instancegroups.go:431] Draining the node: "node-1e.local". I1228 04:20:51.647361 47837 instancegroups.go:431] Draining the node: "node-1d.local". I1228 04:20:51.648479 47837 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1228 04:20:51.648702 47837 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1228 04:20:51.648744 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.649868 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.649901 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.649934 47837 instancegroups.go:431] Draining the node: "node-1f.local". I1228 04:20:51.650688 47837 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1228 04:20:51.650730 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.651865 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.651921 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.752355 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.752408 47837 instancegroups.go:431] Draining the node: "node-1g.local". I1228 04:20:51.753034 47837 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1228 04:20:51.753069 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.754215 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.754243 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.754257 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.22s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I1228 04:20:51.754428 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.754447 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.754455 47837 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1228 04:20:51.755616 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:51.755649 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:51.756396 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:51.756605 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:51.756631 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.757776 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.757812 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.858217 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.858273 47837 instancegroups.go:431] Draining the node: "node-1d.local". I1228 04:20:51.858297 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:51.859309 47837 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1228 04:20:51.859515 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:51.859544 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.860654 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.860681 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.860703 47837 instancegroups.go:431] Draining the node: "node-1e.local". I1228 04:20:51.861234 47837 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1228 04:20:51.861261 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.862401 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.862438 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.962789 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.962848 47837 instancegroups.go:431] Draining the node: "node-1f.local". I1228 04:20:51.963532 47837 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1228 04:20:51.963567 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.964709 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.964749 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.964769 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I1228 04:20:51.965020 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.965050 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.965065 47837 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I1228 04:20:51.967511 47837 instancegroups.go:431] Draining the node: "master-1a.local". I1228 04:20:51.968341 47837 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1228 04:20:51.968417 47837 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1228 04:20:51.968464 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.969625 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.969655 47837 instancegroups.go:540] Cluster validated. I1228 04:20:51.969679 47837 instancegroups.go:431] Draining the node: "master-1c.local". I1228 04:20:51.969727 47837 instancegroups.go:431] Draining the node: "master-1b.local". I1228 04:20:51.970471 47837 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1228 04:20:51.970510 47837 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1228 04:20:51.970653 47837 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I1228 04:20:51.970686 47837 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I1228 04:20:51.970706 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:51.971828 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:51.971871 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.072254 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.072315 47837 instancegroups.go:431] Draining the node: "master-1e.local". I1228 04:20:52.072328 47837 instancegroups.go:431] Draining the node: "master-1d.local". I1228 04:20:52.073271 47837 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I1228 04:20:52.073343 47837 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I1228 04:20:52.073547 47837 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I1228 04:20:52.073586 47837 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I1228 04:20:52.073612 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.074747 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.074786 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.074817 47837 instancegroups.go:431] Draining the node: "master-1f.local". I1228 04:20:52.075563 47837 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I1228 04:20:52.075616 47837 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I1228 04:20:52.075652 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.076765 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.076802 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.177202 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.177269 47837 instancegroups.go:431] Draining the node: "master-1g.local". I1228 04:20:52.178080 47837 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I1228 04:20:52.178153 47837 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I1228 04:20:52.178197 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.179346 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.179388 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.179412 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I1228 04:20:52.179687 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.179724 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.179742 47837 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1228 04:20:52.181549 47837 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1228 04:20:52.181618 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.182744 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.182778 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.182791 47837 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1228 04:20:52.182840 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.183962 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.183995 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.184038 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.184047 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.185130 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.185382 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.185426 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.186553 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.186592 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.287036 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.287108 47837 instancegroups.go:431] Draining the node: "node-1d.local". I1228 04:20:52.287129 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:52.288190 47837 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1228 04:20:52.288391 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:52.288420 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.289539 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.289576 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.289608 47837 instancegroups.go:431] Draining the node: "node-1e.local". I1228 04:20:52.290397 47837 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1228 04:20:52.290444 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.291594 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.291634 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.392041 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.392109 47837 instancegroups.go:431] Draining the node: "node-1f.local". I1228 04:20:52.393019 47837 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1228 04:20:52.393075 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.394236 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.394266 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.394280 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I1228 04:20:52.394489 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.394510 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.394518 47837 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1228 04:20:52.395582 47837 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1228 04:20:52.395614 47837 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1228 04:20:52.395641 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.396760 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.396791 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.396826 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.396859 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.397750 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.397906 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.397933 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.399076 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.399113 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.499512 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.499586 47837 instancegroups.go:431] Draining the node: "node-1d.local". I1228 04:20:52.499599 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:52.500705 47837 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1228 04:20:52.500957 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:52.501001 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.502134 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.502167 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.502202 47837 instancegroups.go:431] Draining the node: "node-1e.local". I1228 04:20:52.502918 47837 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1228 04:20:52.502962 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.504083 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.504140 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.604726 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.604780 47837 instancegroups.go:431] Draining the node: "node-1f.local". I1228 04:20:52.605404 47837 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1228 04:20:52.605444 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.606610 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.606651 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.606677 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I1228 04:20:52.606932 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.606957 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.606968 47837 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1228 04:20:52.607574 47837 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1228 04:20:52.607608 47837 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I1228 04:20:52.607639 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.608795 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.608814 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.613995 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.614032 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.614047 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.614573 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.614596 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.614955 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.614975 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.615739 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.615757 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.621025 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.621050 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I1228 04:20:52.621224 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.621239 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.621247 47837 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1228 04:20:52.621701 47837 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E1228 04:20:52.621736 47837 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I1228 04:20:52.621745 47837 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E1228 04:20:52.621767 47837 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I1228 04:20:52.621785 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.622925 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.622943 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.628108 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.628141 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.628157 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.628649 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.628671 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.629062 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.629085 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.629816 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.629835 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.635026 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.635055 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I1228 04:20:52.635239 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.635262 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.635271 47837 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I1228 04:20:52.636000 47837 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1228 04:20:52.636039 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.637181 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.637206 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.637215 47837 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1228 04:20:52.637247 47837 instancegroups.go:203] waiting for 1ms after detaching instance I1228 04:20:52.638339 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.638356 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.638378 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:52.638394 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.638437 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.638848 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:52.638881 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.639220 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.639245 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.639560 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.639584 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.640023 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.740662 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.740722 47837 instancegroups.go:431] Draining the node: "node-1d.local". I1228 04:20:52.741303 47837 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1228 04:20:52.741339 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.742477 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.742504 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.742517 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I1228 04:20:52.742707 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.742727 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.742736 47837 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1228 04:20:52.743912 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.744344 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.744372 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.745464 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.745482 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.745500 47837 instancegroups.go:431] Draining the node: "node-1e.local". I1228 04:20:52.745516 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:52.746146 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:52.746291 47837 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1228 04:20:52.746321 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.747436 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.747471 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.848083 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.848138 47837 instancegroups.go:431] Draining the node: "node-1g.local". I1228 04:20:52.848189 47837 instancegroups.go:431] Draining the node: "node-1f.local". I1228 04:20:52.848943 47837 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1228 04:20:52.849095 47837 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1228 04:20:52.849123 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.850204 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.850231 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.850250 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.850704 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.850729 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.851874 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.851911 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.952589 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.952643 47837 instancegroups.go:431] Draining the node: "node-1d.local". I1228 04:20:52.953221 47837 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1228 04:20:52.953254 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.954401 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.954427 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.954441 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I1228 04:20:52.954595 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.954609 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.954618 47837 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1228 04:20:52.954632 47837 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1228 04:20:52.954641 47837 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1228 04:20:52.954655 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I1228 04:20:52.954741 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.954754 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.954761 47837 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1228 04:20:52.955339 47837 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1228 04:20:52.955356 47837 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1228 04:20:52.955366 47837 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1228 04:20:52.955386 47837 instancegroups.go:431] Draining the node: "node-1a.local". I1228 04:20:52.955789 47837 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1228 04:20:52.955808 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.956944 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.956963 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.962136 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.962170 47837 instancegroups.go:431] Draining the node: "node-1b.local". I1228 04:20:52.962673 47837 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1228 04:20:52.962696 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.963831 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.963851 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.969030 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.969064 47837 instancegroups.go:431] Draining the node: "node-1c.local". I1228 04:20:52.969579 47837 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1228 04:20:52.969601 47837 instancegroups.go:469] waiting for 1ms after terminating instance I1228 04:20:52.971209 47837 instancegroups.go:504] Validating the cluster. I1228 04:20:52.971228 47837 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1228 04:20:52.976492 47837 instancegroups.go:540] Cluster validated. I1228 04:20:52.976517 47837 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.980s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.004s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.014s === RUN TestParse E1228 04:20:51.010715 47840 versions.go:96] unable to parse Kubernetes version "" E1228 04:20:51.010842 47840 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.010s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.040s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.14s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.201s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.02s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.098s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.072s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.081s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I1228 04:20:51.065107 47845 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.067s === RUN Test_RunEtcdManagerBuilder I1228 04:20:51.082224 47847 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W1228 04:20:51.124748 47847 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W1228 04:20:51.127182 47847 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.05s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.132s === RUN Test_RunKubeApiserverBuilder I1228 04:20:51.083057 47848 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.094s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.094s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.029s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.060s === RUN TestServerGroupBuilder I1228 04:20:58.687647 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.700364 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.709527 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.725254 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.776023 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.795951 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.820942 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.840716 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.861793 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.943750 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.954076 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.963249 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.970522 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.979456 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.990816 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.999776 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:59.007769 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:59.013608 48728 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.39s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.464s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.051s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.047s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.051s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.01s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.95s) --- PASS: TestIssueCert/ca (0.33s) --- PASS: TestIssueCert/client (0.46s) --- PASS: TestIssueCert/clientOneYear (0.16s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 1.004s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.049s === RUN TestAddUntaggedRouteTables I1228 04:20:58.686059 48731 routetable.go:53] DescribeRouteTables: { } W1228 04:20:58.686172 48731 tags.go:67] cluster tag not found on route-table:rtb-1234 I1228 04:20:58.686182 48731 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I1228 04:20:58.686295 48731 iaminstanceprofile.go:193] ListInstanceProfiles: { } W1228 04:20:58.686353 48731 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I1228 04:20:58.686422 48731 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I1228 04:20:58.686487 48731 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I1228 04:20:58.686539 48731 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I1228 04:20:58.686600 48731 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I1228 04:20:58.686694 48731 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I1228 04:20:58.686732 48731 volumes.go:128] DescribeVolumes: { } W1228 04:20:58.686758 48731 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I1228 04:20:58.686917 48731 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:20:58.687005 48731 internetgateways.go:66] CreateInternetGateway: { } I1228 04:20:58.687033 48731 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:20:58.687084 48731 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:20:58.687120 48731 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:20:58.687175 48731 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:20:58.687215 48731 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:20:58.687228 48731 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:20:58.687251 48731 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:20:58.687273 48731 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:20:58.687291 48731 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I1228 04:20:58.687331 48731 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I1228 04:20:58.687348 48731 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I1228 04:20:58.687372 48731 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I1228 04:20:58.687407 48731 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I1228 04:20:58.687431 48731 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I1228 04:20:58.687471 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I1228 04:20:58.687496 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I1228 04:20:58.687526 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I1228 04:20:58.687544 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I1228 04:20:58.687569 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I1228 04:20:58.687585 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I1228 04:20:58.687603 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I1228 04:20:58.687641 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I1228 04:20:58.687662 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I1228 04:20:58.687677 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I1228 04:20:58.687694 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I1228 04:20:58.687714 48731 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.069s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.072s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.058s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.048s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.003s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.003s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.045s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.101s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.006s === RUN TestRemovesDuplicateGuardedBlocks W1228 04:21:06.207322 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207396 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207409 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207422 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207435 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207448 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207460 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207472 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207484 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207497 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207509 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207520 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207531 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207544 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.207556 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.207568 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.220719 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.220763 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.220864 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.220881 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.220978 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.220995 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221087 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221104 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221193 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221211 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221339 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221362 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221461 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221480 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221600 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221619 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221709 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221728 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221832 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.221877 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.221982 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222001 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222088 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222106 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222195 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222213 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222303 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222321 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222409 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222428 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222525 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222543 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222634 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222652 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222739 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222758 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222846 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222866 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.222954 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.222980 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223146 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223164 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223256 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223273 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223362 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223381 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223475 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223495 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223598 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223619 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223730 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223750 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223849 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223869 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.223963 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.223982 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224080 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224098 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224190 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224211 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224314 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224335 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224435 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224456 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224547 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224564 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224653 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224669 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224754 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224771 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224868 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224884 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.224968 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.224985 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225064 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225079 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225166 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225182 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225286 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225304 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225384 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225401 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225482 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225503 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225647 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225662 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225744 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225762 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225840 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225856 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.225938 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.225956 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226050 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226084 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226173 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226191 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226271 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226288 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226370 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226387 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226466 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226487 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226568 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226586 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226669 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226687 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226769 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226787 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.226883 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.226954 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227039 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227056 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227134 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227149 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227220 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227235 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227301 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227316 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227385 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227401 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227468 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227483 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227550 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227565 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227634 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227650 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227721 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227736 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227838 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227853 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.227923 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.227942 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228019 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228035 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228092 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228109 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228168 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228183 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228243 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228256 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228319 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228330 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228394 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228406 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228471 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228483 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228551 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228564 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228628 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228640 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228702 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228714 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228780 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228792 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228854 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228865 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.228930 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.228942 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.229006 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.229018 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.229080 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.229092 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.229158 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.229170 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.229234 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.229245 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.229308 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.229320 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230007 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230022 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230087 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230098 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230236 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230250 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230318 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230330 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230393 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230405 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230468 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230480 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230543 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230554 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230616 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230627 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230689 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230700 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230762 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230774 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230838 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230871 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.230935 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.230952 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231013 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231025 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231086 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231097 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231159 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231171 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W1228 04:21:06.231532 50010 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1228 04:21:06.231546 50010 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1228 04:21:06.231559 50010 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1228 04:21:06.231571 50010 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1228 04:21:06.231584 50010 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1228 04:21:06.231594 50010 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1228 04:21:06.231605 50010 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1228 04:21:06.231645 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231659 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231673 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231709 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231724 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231736 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231750 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231763 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231775 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231786 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231803 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231816 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231828 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231841 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.231853 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.231864 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245258 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245285 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245358 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245369 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245427 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245437 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245493 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245504 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245556 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245567 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245618 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245632 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245699 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245710 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245813 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245823 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245878 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245889 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.245942 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.245952 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246008 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246019 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246072 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246083 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246137 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246148 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246202 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246213 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246264 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246277 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246329 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246340 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246394 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246405 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246480 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246492 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246545 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246556 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246609 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246619 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246695 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246706 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246759 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246770 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246820 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246831 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246904 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246915 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.246969 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.246980 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247033 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247045 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247099 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247108 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247175 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247186 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247240 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247250 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247302 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247312 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247363 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247373 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247445 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247456 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247509 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247520 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247574 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247585 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247636 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247647 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247700 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247711 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247763 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247774 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247825 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247835 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247889 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247899 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.247952 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.247962 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248014 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248025 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248076 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248086 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248143 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248157 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248246 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248271 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248354 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248366 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248421 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248431 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248485 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248495 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248568 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248579 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248633 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248643 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248695 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248705 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248755 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248765 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248818 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248828 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248879 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248888 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.248941 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.248951 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249001 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249011 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249083 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249093 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249144 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249155 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249207 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249217 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249269 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249281 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249335 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249346 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249397 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249408 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249459 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249470 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249523 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249533 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249587 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249598 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249670 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249684 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249739 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249750 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249805 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249815 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249868 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249879 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249930 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.249940 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.249991 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250001 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250055 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250065 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250116 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250127 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250196 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250209 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250264 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250275 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250326 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250337 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250393 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250403 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250456 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250467 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250518 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250528 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250581 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250593 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250683 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250701 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250788 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250807 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.250893 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.250914 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251002 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251024 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251165 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251184 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251279 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251298 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251382 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251400 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251482 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251500 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251590 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251613 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251705 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251725 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251831 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251851 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.251946 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.251966 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252064 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252094 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252189 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252208 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252305 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252326 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252420 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252440 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252526 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252544 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252630 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252649 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252737 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252757 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1228 04:21:06.252840 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1228 04:21:06.252860 50010 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.050s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.055s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.02s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.084s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.02s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.02s) PASS ok k8s.io/kops/tests/integration/conversion 0.055s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I1228 04:21:06.238007 50014 files.go:57] Writing file "/tmp/TestWriteFile3147678224/001/SubDir/test1.tmp" I1228 04:21:06.238131 50014 files.go:113] Changing file mode for "/tmp/TestWriteFile3147678224/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.01s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.047s === RUN TestBootstrapChannelBuilder_BuildTasks I1228 04:21:09.126754 50826 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:09.126981 50826 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:09.127034 50826 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:09.127082 50826 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:09.127131 50826 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:09.127205 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:09.127251 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:09.127275 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:09.127315 50826 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:09.127357 50826 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:09.135976 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.263183 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.430062 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.576868 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.707457 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.817657 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:09.961867 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:10.112272 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:10.597834 50826 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.57s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I1228 04:21:10.700519 50826 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:10.700601 50826 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:10.700646 50826 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:10.700679 50826 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:10.700704 50826 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:10.700737 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:10.700764 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:10.700780 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:10.700803 50826 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:10.700820 50826 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:10.700841 50826 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I1228 04:21:10.701959 50826 zones.go:93] ListHostedZonesPages { } I1228 04:21:10.844774 50826 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.14s) === RUN TestBootstrapChannelBuilder_AWSCloudController I1228 04:21:10.844933 50826 featureflag.go:164] FeatureFlag "ImageDigest"=false I1228 04:21:10.845009 50826 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:10.845054 50826 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1228 04:21:10.845087 50826 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1228 04:21:10.845112 50826 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1228 04:21:10.845145 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1228 04:21:10.845170 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1228 04:21:10.845186 50826 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1228 04:21:10.845208 50826 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1228 04:21:10.845224 50826 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1228 04:21:10.846353 50826 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.10s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.20s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W1228 04:21:11.161842 50826 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I1228 04:21:11.195519 50826 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I1228 04:21:11.195608 50826 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I1228 04:21:11.195633 50826 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I1228 04:21:11.195714 50826 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I1228 04:21:11.195739 50826 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I1228 04:21:11.195819 50826 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I1228 04:21:11.195901 50826 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I1228 04:21:11.195986 50826 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1228 04:21:11.196011 50826 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I1228 04:21:11.196092 50826 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1228 04:21:11.196117 50826 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I1228 04:21:11.196241 50826 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I1228 04:21:11.196368 50826 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I1228 04:21:11.196453 50826 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I1228 04:21:11.196475 50826 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I1228 04:21:11.196500 50826 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I1228 04:21:11.196526 50826 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I1228 04:21:11.196550 50826 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I1228 04:21:11.196574 50826 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I1228 04:21:11.196597 50826 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I1228 04:21:11.196622 50826 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I1228 04:21:11.198013 50826 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I1228 04:21:11.198258 50826 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.165s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I1228 04:21:09.120676 50827 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3229420336/001 I1228 04:21:09.121095 50827 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3229420336/001 I1228 04:21:09.121898 50827 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3229420336/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.01s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I1228 04:21:09.128627 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1228 04:21:09.128718 50827 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1228 04:21:09.128790 50827 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I1228 04:21:09.128911 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.129074 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.129136 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.129154 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.129392 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.129426 50827 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1228 04:21:09.129463 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.129525 50827 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1228 04:21:09.129607 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1228 04:21:09.129662 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.129709 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.129747 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.129761 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.129792 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.129825 50827 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1228 04:21:09.129876 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I1228 04:21:09.129983 50827 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1228 04:21:09.130042 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.130129 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1228 04:21:09.130164 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.130208 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.130234 50827 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1228 04:21:09.130304 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.130456 50827 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1228 04:21:09.130500 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.130523 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.130546 50827 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1228 04:21:09.130592 50827 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.130733 50827 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I1228 04:21:09.130795 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.130817 50827 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" },{ Key: "AssociatedElasticIp", Value: "192.0.2.1" }] } I1228 04:21:09.130852 50827 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1228 04:21:09.130913 50827 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1228 04:21:09.130950 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.130988 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.131005 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.131027 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.131048 50827 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1228 04:21:09.131094 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.131145 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.131171 50827 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1228 04:21:09.131205 50827 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.131248 50827 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I1228 04:21:09.131272 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1228 04:21:09.131305 50827 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I1228 04:21:09.131358 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1228 04:21:09.131398 50827 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1228 04:21:09.131418 50827 internetgateways.go:66] CreateInternetGateway: { } I1228 04:21:09.131432 50827 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I1228 04:21:09.131478 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.131512 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.131544 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.131558 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.131615 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.131641 50827 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1228 04:21:09.131669 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.131720 50827 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1228 04:21:09.131786 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1228 04:21:09.131834 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.131867 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.131902 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.131919 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.131946 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.131979 50827 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1228 04:21:09.132027 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I1228 04:21:09.132441 50827 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender492611994/001 I1228 04:21:09.132684 50827 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender492611994/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I1228 04:21:09.133008 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.133048 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.133126 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1228 04:21:09.133167 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.133188 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.133210 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.133284 50827 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1228 04:21:09.133479 50827 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I1228 04:21:09.133532 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1228 04:21:09.133564 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1228 04:21:09.133614 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.133651 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.133690 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.133707 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.133730 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.133751 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.133788 50827 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1228 04:21:09.133851 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I1228 04:21:09.134061 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.134101 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.134182 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1228 04:21:09.134223 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.134244 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.134266 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.134302 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.134391 50827 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1228 04:21:09.134428 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.134448 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.134469 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1228 04:21:09.134529 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.134564 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.134602 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.134618 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.134640 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.134661 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.134692 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.134740 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.134761 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I1228 04:21:09.134851 50827 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1228 04:21:09.134885 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.134972 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1228 04:21:09.135007 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.135030 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.135054 50827 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1228 04:21:09.135128 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.135269 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.135473 50827 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:21:09.135454 50827 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1228 04:21:09.135564 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.135593 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.135619 50827 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1228 04:21:09.135687 50827 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1228 04:21:09.135734 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.135778 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.135793 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.135819 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.135842 50827 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1228 04:21:09.135878 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.135932 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.135977 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.136025 50827 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I1228 04:21:09.136122 50827 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1228 04:21:09.136160 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.136234 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1228 04:21:09.136270 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.136290 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.136311 50827 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1228 04:21:09.136347 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.136497 50827 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1228 04:21:09.136471 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.136577 50827 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1228 04:21:09.136608 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.136630 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.136649 50827 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1228 04:21:09.136719 50827 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1228 04:21:09.136761 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.136800 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.136816 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.136858 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.136893 50827 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1228 04:21:09.136934 50827 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1228 04:21:09.137022 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.137057 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.137154 50827 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I1228 04:21:09.137253 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I1228 04:21:09.137359 50827 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I1228 04:21:09.137475 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.137541 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.137603 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.137630 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.137737 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.137780 50827 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1228 04:21:09.137830 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.137884 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.138046 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1228 04:21:09.138089 50827 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1228 04:21:09.138140 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1228 04:21:09.138275 50827 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1228 04:21:09.138340 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.138404 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.138434 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.138487 50827 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1228 04:21:09.138545 50827 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1228 04:21:09.138634 50827 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I1228 04:21:09.138757 50827 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:09.138816 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.138944 50827 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1228 04:21:09.139003 50827 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1228 04:21:09.139040 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.139077 50827 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:09.139132 50827 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:09.139203 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1228 04:21:09.139282 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.139310 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.139352 50827 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1228 04:21:09.139394 50827 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I1228 04:21:09.139628 50827 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I1228 04:21:09.139753 50827 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:09.139833 50827 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I1228 04:21:09.139926 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1228 04:21:09.139981 50827 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1228 04:21:09.140059 50827 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.081s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.076s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.057s === RUN TestDiskRenderAzure I1228 04:21:12.129413 51075 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I1228 04:21:12.130032 51075 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.01s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I1228 04:21:12.137186 51075 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I1228 04:21:12.138452 51075 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I1228 04:21:12.138859 51075 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I1228 04:21:12.139286 51075 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I1228 04:21:12.139719 51075 resourcegroup.go:108] Creating a new Resource Group with name: rg I1228 04:21:12.139744 51075 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I1228 04:21:12.140143 51075 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I1228 04:21:12.142625 51075 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I1228 04:21:12.143189 51075 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I1228 04:21:12.143694 51075 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I1228 04:21:12.144086 51075 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I1228 04:21:12.144379 51075 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.062s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.037s === RUN TestProjectIAMBinding I1228 04:21:12.171791 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.172652 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:12.172750 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.173561 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:12.173652 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.173987 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I1228 04:21:12.174224 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.174443 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:12.174479 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.174719 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:12.174759 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.174838 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I1228 04:21:12.174998 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.175442 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:12.175477 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.175995 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1228 04:21:12.176054 51077 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1228 04:21:12.176275 51077 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.097s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.02s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.098s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.063s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.037s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.043s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.006s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.043s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I1228 04:21:14.157446 51965 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I1228 04:21:14.157515 51965 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I1228 04:21:14.157527 51965 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I1228 04:21:14.157540 51965 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I1228 04:21:14.157550 51965 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I1228 04:21:14.157561 51965 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I1228 04:21:14.157571 51965 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W1228 04:21:14.157991 51965 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.061s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.004s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.004s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.004s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.004s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.004s === RUN TestGetProxyEnvVars W1228 04:21:14.123411 51971 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.024s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.028s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.004s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.003s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.028s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W1228 04:21:18.235592 52070 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.065s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 144.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.2-r0.apk >>> kops: Build complete at Thu, 28 Dec 2023 04:23:57 +0000 elapsed time 0h 6m 24s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20231228.041735) (2/5) Purging kubernetes (1.29.0-r0) (3/5) Purging go (1.21.5-r0) (4/5) Purging bash (5.2.21-r0) Executing bash-5.2.21-r0.pre-deinstall (5/5) Purging readline (8.2.7-r0) Executing busybox-1.36.1-r18.trigger OK: 378 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...