>>> kops: Building testing/kops 1.28.0-r1 (using abuild 3.11.21-r0) started Fri, 13 Oct 2023 02:44:32 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.28.2-r1) (2/5) Installing go (1.21.3-r0) (3/5) Installing readline (8.2.1-r2) (4/5) Installing bash (5.2.15-r6) Executing bash-5.2.15-r6.post-install (5/5) Installing .makedepends-kops (20231013.024434) Executing busybox-1.36.1-r13.trigger OK: 557 MiB in 115 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.0.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.6M 100 32.6M 0 0 52.3M 0 --:--:-- --:--:-- --:--:-- 52.4M >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.0.tar.gz >>> kops: Checking sha512sums... kops-1.28.0.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.0.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.0/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.0/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.0 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading k8s.io/apimachinery v0.28.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading golang.org/x/crypto v0.12.0 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/spf13/viper v1.16.0 go: downloading github.com/aws/aws-sdk-go v1.45.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading k8s.io/api v0.28.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/client-go v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.14.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/google/gofuzz v1.2.0 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/pkg/errors v0.9.1 go: downloading golang.org/x/sys v0.11.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/term v0.11.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading golang.org/x/text v0.12.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading k8s.io/component-helpers v0.28.1 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/google/btree v1.0.1 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/moby/locker v1.0.1 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I1013 02:47:05.039138 1806 addon.go:250] addon test wants to update all nodes I1013 02:47:05.041088 1806 addon.go:250] addon test wants to update workers nodes I1013 02:47:05.041423 1806 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I1013 02:47:05.041771 1806 addon.go:283] installing PKI for "test" I1013 02:47:05.937910 1806 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (1.37s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 1.438s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.071s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I1013 02:47:07.036868 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.037137 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.037195 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.037245 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.037300 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.037367 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.037421 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.037439 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.037462 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.037488 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.042750 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.042813 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.087551 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.087783 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.088173 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:07.101636 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.101716 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.101760 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.101791 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.101813 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.101851 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.101878 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.101895 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.101917 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.101933 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.107881 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.107932 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.170629 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.170833 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.171150 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:07.176702 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.176773 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.176808 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.176842 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.176867 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.176898 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.176926 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.176943 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.176965 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.176983 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.180696 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.180748 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.249092 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.249263 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.249541 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:07.255759 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.255837 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.255865 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.255902 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.255928 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.255955 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.255982 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.255998 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.256026 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.256046 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.260116 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.260189 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.362690 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.362870 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.363254 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:07.368805 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.368879 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.368907 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.368942 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.368968 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.369001 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.369028 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.369059 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.369083 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.369099 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.404215 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.404275 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.542778 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.542967 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.543272 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:07.550014 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.550125 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.550221 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.550297 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.550362 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.550440 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.550517 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.550574 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.550643 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.550696 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.555364 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.555421 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.602659 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.602897 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.603517 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:07.613368 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.613494 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.613539 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.613641 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.613727 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.613814 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.613866 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.613899 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.613969 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.614040 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.627662 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.627722 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.706504 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:07.706804 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:07.707301 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.68s) === RUN TestCreateClusterHetzner I1013 02:47:07.716995 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.717151 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.717190 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.717238 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.717276 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.717327 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.717372 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.717421 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.717462 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.717489 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.727266 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.727347 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1013 02:47:07.773041 3037 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1013 02:47:07.773088 3037 new_cluster.go:1373] Cloud Provider ID: "hetzner" I1013 02:47:07.779947 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.780035 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.780067 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.780097 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.780120 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.780150 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.780177 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.780195 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.780220 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.780238 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.785868 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.785926 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.830478 3037 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.12s) === RUN TestCreateClusterOpenStack I1013 02:47:07.835773 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.835857 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.835885 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.835915 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.835941 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.835973 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.835998 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.836018 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.836042 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.836058 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.839494 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.839538 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1013 02:47:07.880611 3037 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1013 02:47:07.880657 3037 new_cluster.go:1373] Cloud Provider ID: "openstack" I1013 02:47:07.882819 3037 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.06s) === RUN TestCreateClusterOpenStackOctavia I1013 02:47:07.894423 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.894538 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.894573 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.894613 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.894652 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.894697 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.894738 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.894766 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.894806 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.894831 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.898723 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.898764 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1013 02:47:07.942651 3037 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1013 02:47:07.942699 3037 new_cluster.go:1373] Cloud Provider ID: "openstack" I1013 02:47:07.944764 3037 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1013 02:47:07.944797 3037 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.06s) === RUN TestCreateClusterOpenStackNoDNS I1013 02:47:07.956207 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:07.956312 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:07.956346 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:07.956395 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:07.956431 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:07.956478 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:07.956516 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:07.956546 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:07.956586 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:07.956614 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:07.960390 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:07.960431 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1013 02:47:08.045537 3037 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1013 02:47:08.045595 3037 new_cluster.go:1373] Cloud Provider ID: "openstack" I1013 02:47:08.045659 3037 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1013 02:47:08.045685 3037 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.10s) === RUN TestCreateClusterCilium I1013 02:47:08.056073 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.056196 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.056237 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.056287 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.056327 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.056376 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.056418 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.056451 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.056491 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.056516 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.061941 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.062003 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.117536 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.117741 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:08.118125 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.07s) === RUN TestCreateClusterOverride I1013 02:47:08.128387 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.128506 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.128548 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.128602 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.128652 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.128702 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.128747 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.128778 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.128816 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.128845 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.176559 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.176638 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.237970 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.238823 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:08.239298 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.12s) === RUN TestCreateClusterKubernetesFeatureGates I1013 02:47:08.248700 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.248819 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.248858 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.248904 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.248947 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.248997 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.249042 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.249076 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.249121 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.249152 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.252951 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.252993 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.283259 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.283436 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:08.283849 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.04s) === RUN TestCreateClusterComplex I1013 02:47:08.290570 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.290662 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.290690 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.290741 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.290772 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.290803 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.290830 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.290847 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.290873 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.290891 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.294664 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.294704 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.369593 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.370488 3037 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I1013 02:47:08.370520 3037 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I1013 02:47:08.370540 3037 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I1013 02:47:08.371936 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.09s) === RUN TestCreateClusterComplexPrivate I1013 02:47:08.382430 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.382545 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.382577 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.382621 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.382650 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.382688 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.382721 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.382742 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.382782 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.382804 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.386842 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.386900 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.435152 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.435546 3037 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I1013 02:47:08.435566 3037 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I1013 02:47:08.435578 3037 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I1013 02:47:08.435590 3037 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I1013 02:47:08.435602 3037 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I1013 02:47:08.435614 3037 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I1013 02:47:08.435627 3037 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I1013 02:47:08.435640 3037 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I1013 02:47:08.435655 3037 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I1013 02:47:08.435668 3037 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I1013 02:47:08.436167 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.07s) === RUN TestCreateClusterHA I1013 02:47:08.448144 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.448237 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.448268 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.448298 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.448322 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.448356 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.448382 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.448399 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.448425 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.448443 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.452258 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.452308 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.481812 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.482137 3037 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1013 02:47:08.482160 3037 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1013 02:47:08.482173 3037 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1013 02:47:08.482536 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:08.494584 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.494666 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.494693 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.494725 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.494751 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.494782 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.494809 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.494828 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.494851 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.494869 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.498450 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.498490 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.531374 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.531701 3037 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1013 02:47:08.531720 3037 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1013 02:47:08.531733 3037 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1013 02:47:08.532076 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.09s) === RUN TestCreateClusterMinimalGCE I1013 02:47:08.540985 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.541078 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.541115 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.541146 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.541172 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.541202 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.541230 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.541247 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.541273 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.541292 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.544694 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.544761 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.600167 3037 new_cluster.go:1373] Cloud Provider ID: "gce" I1013 02:47:08.600294 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I1013 02:47:08.606028 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.606112 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.606142 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.606174 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.606198 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.606231 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.606259 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.606276 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.606304 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.606333 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.614520 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.614581 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.645957 3037 new_cluster.go:1373] Cloud Provider ID: "gce" I1013 02:47:08.646052 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.11s) === RUN TestCreateClusterHAGCE I1013 02:47:08.654140 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.654240 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.654268 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.654298 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.654326 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.654357 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.654384 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.654401 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.654425 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.654442 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.658075 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.658179 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.703893 3037 new_cluster.go:1373] Cloud Provider ID: "gce" I1013 02:47:08.704030 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.06s) === RUN TestCreateClusterGCE I1013 02:47:08.712708 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.712792 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.712819 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.712850 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.712876 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.712905 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.712932 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.712985 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.713011 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.713029 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.716844 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.716882 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.809382 3037 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1013 02:47:08.809467 3037 new_cluster.go:1373] Cloud Provider ID: "gce" I1013 02:47:08.809548 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.10s) === RUN TestCreateClusterHASharedZone I1013 02:47:08.815412 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.815518 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.815547 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.815577 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.815601 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.815633 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.815659 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.815678 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.815700 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.815718 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.818993 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.819041 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1013 02:47:08.885597 3037 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1013 02:47:08.885659 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.886068 3037 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1013 02:47:08.886564 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.08s) === RUN TestCreateClusterHASharedZones I1013 02:47:08.900119 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.900243 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.900279 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.900329 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.900368 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.900414 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.900453 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.900481 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.900518 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.900545 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.904631 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.904677 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1013 02:47:08.951379 3037 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1013 02:47:08.951432 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:08.951790 3037 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I1013 02:47:08.951810 3037 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I1013 02:47:08.952196 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.06s) === RUN TestCreateClusterPrivate I1013 02:47:08.962302 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:08.962393 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:08.962419 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:08.962448 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:08.962474 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:08.962506 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:08.962539 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:08.962558 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:08.962583 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:08.962601 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:08.966807 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:08.966866 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.017902 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.018137 3037 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1013 02:47:09.018157 3037 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1013 02:47:09.018524 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:09.018556 3037 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.06s) === RUN TestCreateClusterPrivateGCE I1013 02:47:09.025499 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.025593 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.025619 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.025649 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.025674 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.025703 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.025730 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.025749 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.025772 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.025789 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.029703 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.029741 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.089790 3037 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1013 02:47:09.089877 3037 new_cluster.go:1373] Cloud Provider ID: "gce" I1013 02:47:09.089977 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.07s) === RUN TestCreateClusterWithNGWSpecified I1013 02:47:09.097154 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.097242 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.097272 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.097305 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.097330 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.097361 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.097406 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.097427 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.097451 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.097469 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.101647 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.101695 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.184152 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.184375 3037 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1013 02:47:09.184395 3037 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1013 02:47:09.184753 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:09.184786 3037 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.09s) === RUN TestCreateClusterWithINGWSpecified I1013 02:47:09.191391 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.191474 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.191499 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.191527 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.191556 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.191587 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.191614 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.191631 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.191654 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.191670 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.195703 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.195747 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.244609 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.244845 3037 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1013 02:47:09.244865 3037 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1013 02:47:09.245236 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:09.245269 3037 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.06s) === RUN TestCreateClusterSharedVPC I1013 02:47:09.251998 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.252093 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.252124 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.252156 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.252185 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.252219 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.252249 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.252269 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.252295 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.252315 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.256120 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.256188 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.325845 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.326096 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.326174 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.326232 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.326259 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.326320 3037 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I1013 02:47:09.326799 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.08s) === RUN TestCreateClusterSharedSubnets I1013 02:47:09.335486 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.335601 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.335639 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.335683 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.335721 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.335766 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.335805 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.335835 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.335871 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.335898 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.340621 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.340695 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.384528 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.384577 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.384659 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.384799 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.384821 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.384846 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.384863 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.385218 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.06s) === RUN TestCreateClusterSharedSubnetsVpcLookup I1013 02:47:09.390798 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.390887 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.390915 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.390941 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.390965 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.390999 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.391025 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.391055 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.391088 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.391106 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.394982 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.395057 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.463455 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:09.463522 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.463559 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.463655 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.463809 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.463835 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.463875 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.463904 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.464457 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.09s) === RUN TestCreateClusterPrivateSharedSubnets I1013 02:47:09.479456 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.479578 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.479616 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.479662 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.479706 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.479760 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.479808 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.479844 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.479894 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.479925 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.484036 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.484090 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.595005 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.595055 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.595108 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.595127 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.595190 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.595338 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.595360 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.595382 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:47:09.595399 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:47:09.595777 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.13s) === RUN TestCreateClusterIPv6 I1013 02:47:09.604870 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.604964 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.604993 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.605026 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.605052 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.605084 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.605111 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.605128 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.605151 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.605168 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.608794 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.608838 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.680539 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.680734 3037 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I1013 02:47:09.680754 3037 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I1013 02:47:09.681281 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.08s) === RUN TestCreateClusterDifferentAMIs I1013 02:47:09.687557 3037 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1013 02:47:09.687571 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.687649 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.687674 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.687703 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.687728 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.687758 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.687787 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.687805 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.687827 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.687846 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.691378 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.691415 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.801238 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.801335 3037 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1013 02:47:09.801353 3037 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1013 02:47:09.801718 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:09.808857 3037 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.12s) === RUN TestCreateClusterKarpenter I1013 02:47:09.808943 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.809031 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.809056 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.809086 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.809110 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.809141 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.809169 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.809187 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.809211 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.809229 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.812862 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.812907 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1013 02:47:09.898736 3037 new_cluster.go:1373] Cloud Provider ID: "aws" I1013 02:47:09.898916 3037 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1013 02:47:09.898934 3037 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1013 02:47:09.898948 3037 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1013 02:47:09.899322 3037 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.10s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I1013 02:47:09.905661 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.905733 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.905757 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.905815 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.905840 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.905871 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.905898 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.905915 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.905937 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.905956 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.911437 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I1013 02:47:09.912654 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:09.912738 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:09.912762 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:09.912787 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:09.912812 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:09.912865 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:09.912919 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:09.912937 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:09.912960 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:09.912976 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:09.932724 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1013 02:47:09.934579 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:09.934636 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1013 02:47:14.667626 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:17.213502 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:47:17.219813 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:17.219841 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:17.219911 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:17.220441 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:47:17.224584 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:47:17.225851 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:17.226029 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:17.226240 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:17.226780 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:17.226896 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:47:17.227244 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:47:17.227739 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:47:17.232825 3037 target.go:111] Terraform output is in /tmp/test3848067697/out --- PASS: TestMinimal (7.32s) === RUN TestMinimal_v1_23 I1013 02:47:17.236922 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:17.237065 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:17.237154 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:17.237238 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:17.237318 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:17.237421 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:17.237554 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:17.237620 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:17.237693 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:17.237751 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:17.266929 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1013 02:47:17.270403 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:17.270494 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:18.877279 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:19.003175 3037 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1013 02:47:19.003440 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:19.003471 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:19.003563 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:19.007473 3037 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1013 02:47:19.014349 3037 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1013 02:47:19.014773 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:19.015163 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:19.015489 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:19.015566 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:19.015650 3037 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1013 02:47:19.015870 3037 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1013 02:47:19.016073 3037 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1013 02:47:19.020748 3037 target.go:111] Terraform output is in /tmp/test3782679627/out --- PASS: TestMinimal_v1_23 (1.79s) === RUN TestMinimal_v1_24 I1013 02:47:19.024362 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:19.024484 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:19.024528 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:19.024571 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:19.024609 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:19.024655 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:19.024732 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:19.024759 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:19.024794 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:19.024820 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:19.049343 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:47:19.052364 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:19.052445 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:20.181856 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:20.324591 3037 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1013 02:47:20.327138 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:20.327186 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:20.327323 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:20.330681 3037 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1013 02:47:20.335938 3037 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1013 02:47:20.337095 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:20.337625 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:20.338340 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:20.339032 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:20.339326 3037 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1013 02:47:20.339703 3037 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1013 02:47:20.340083 3037 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1013 02:47:20.345399 3037 target.go:111] Terraform output is in /tmp/test1974484437/out --- PASS: TestMinimal_v1_24 (1.33s) === RUN TestMinimal_v1_25 I1013 02:47:20.349901 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:20.350050 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:20.350096 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:20.350151 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:20.350199 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:20.350250 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:20.350336 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:20.350369 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:20.350420 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:20.350450 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:20.372078 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:47:20.374029 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:20.374111 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:21.959610 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:22.143243 3037 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1013 02:47:22.143520 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:22.143541 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:22.143607 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:22.147102 3037 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1013 02:47:22.153887 3037 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1013 02:47:22.154290 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:22.154467 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:22.154636 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:22.154935 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:22.155001 3037 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1013 02:47:22.155187 3037 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1013 02:47:22.155375 3037 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1013 02:47:22.160438 3037 target.go:111] Terraform output is in /tmp/test1028880037/out --- PASS: TestMinimal_v1_25 (1.81s) === RUN TestMinimal_v1_26 I1013 02:47:22.164598 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:22.164713 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:22.164752 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:22.164798 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:22.164841 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:22.164890 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:22.164967 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:22.164998 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:22.165039 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:22.165069 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:22.193164 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:47:22.196516 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:22.196604 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:23.640216 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:23.821999 3037 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1013 02:47:23.823261 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:23.823297 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:23.823387 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:23.824322 3037 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1013 02:47:23.829705 3037 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1013 02:47:23.829929 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:23.830141 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:23.830393 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:23.830596 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:23.830661 3037 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1013 02:47:23.830940 3037 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1013 02:47:23.831216 3037 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1013 02:47:23.836462 3037 target.go:111] Terraform output is in /tmp/test525505307/out --- PASS: TestMinimal_v1_26 (1.68s) === RUN TestMinimal_v1_27 I1013 02:47:23.840506 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:23.840629 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:23.840670 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:23.840734 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:23.840780 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:23.840831 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:23.840913 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:23.840946 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:23.840989 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:23.841019 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:23.870028 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1013 02:47:23.873317 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:23.873409 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:26.163733 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:26.299861 3037 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1013 02:47:26.300259 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:26.300284 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:26.300358 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:26.302580 3037 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1013 02:47:26.309687 3037 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1013 02:47:26.309950 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:26.310075 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:26.310327 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:26.310536 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:26.310600 3037 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1013 02:47:26.310817 3037 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1013 02:47:26.311156 3037 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1013 02:47:26.316005 3037 target.go:111] Terraform output is in /tmp/test2541373438/out --- PASS: TestMinimal_v1_27 (2.48s) === RUN TestMinimal_NoneDNS I1013 02:47:26.319852 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:26.319975 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:26.320016 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:26.320060 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:26.320101 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:26.320149 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:26.320229 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:26.320261 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:26.320297 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:26.320328 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:47:26.344341 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:26.344410 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:27.205902 3037 executor.go:111] Tasks: 0 done / 110 total; 43 can run I1013 02:47:27.208333 3037 executor.go:111] Tasks: 43 done / 110 total; 24 can run I1013 02:47:27.211329 3037 executor.go:111] Tasks: 67 done / 110 total; 29 can run I1013 02:47:27.211997 3037 executor.go:111] Tasks: 96 done / 110 total; 2 can run I1013 02:47:27.212031 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:27.212080 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:27.212181 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:27.212229 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:27.215212 3037 executor.go:111] Tasks: 98 done / 110 total; 4 can run I1013 02:47:27.215322 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:27.215396 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:27.215601 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:27.215794 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:27.215850 3037 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1013 02:47:27.216021 3037 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1013 02:47:27.216230 3037 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1013 02:47:27.219598 3037 target.go:111] Terraform output is in /tmp/test2529916445/out --- PASS: TestMinimal_NoneDNS (0.90s) === RUN TestHetzner I1013 02:47:27.222417 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:28.349839 3037 executor.go:111] Tasks: 0 done / 46 total; 37 can run I1013 02:47:28.355077 3037 executor.go:111] Tasks: 37 done / 46 total; 3 can run I1013 02:47:28.355308 3037 executor.go:111] Tasks: 40 done / 46 total; 2 can run I1013 02:47:28.359831 3037 executor.go:111] Tasks: 42 done / 46 total; 4 can run I1013 02:47:28.360788 3037 executor.go:111] Tasks: 46 done / 46 total; 0 can run I1013 02:47:28.362711 3037 target.go:111] Terraform output is in /tmp/test1773517987/out --- PASS: TestHetzner (1.14s) === RUN TestNvidia I1013 02:47:28.364952 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:28.365078 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:28.365132 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:28.365175 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:28.365208 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:28.365252 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:28.365326 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:28.365352 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:28.365387 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:28.365412 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:28.383787 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:28.386106 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:28.386171 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:29.691441 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:29.815849 3037 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1013 02:47:29.816406 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:29.816428 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:29.816486 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:29.819050 3037 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1013 02:47:29.822461 3037 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1013 02:47:29.822665 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:29.822756 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:29.823008 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:29.823115 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:29.823179 3037 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1013 02:47:29.823324 3037 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1013 02:47:29.823571 3037 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1013 02:47:29.828224 3037 target.go:111] Terraform output is in /tmp/test2544796582/out --- PASS: TestNvidia (1.47s) === RUN TestMinimalGossip I1013 02:47:29.833161 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:29.833252 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:29.833279 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:29.833310 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:29.833335 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:29.833366 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:29.833418 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:29.833435 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:29.833460 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:29.833480 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:29.849542 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:29.849597 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:30.895858 3037 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1013 02:47:30.904424 3037 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1013 02:47:30.910669 3037 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1013 02:47:30.910985 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:30.911218 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:30.911442 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:30.911713 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:30.911831 3037 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1013 02:47:30.912088 3037 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1013 02:47:30.912421 3037 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1013 02:47:30.917731 3037 target.go:111] Terraform output is in /tmp/test3720778370/out --- PASS: TestMinimalGossip (1.09s) === RUN TestMinimalGossipIRSA I1013 02:47:30.922177 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:30.922308 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:30.922350 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:30.922399 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:30.922440 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:30.922489 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:30.922572 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:30.922602 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:30.922640 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:30.922669 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:30.951158 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:30.951242 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:31.866355 3037 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1013 02:47:31.868330 3037 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1013 02:47:31.876201 3037 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1013 02:47:31.876496 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:31.877013 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:31.877102 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:31.877564 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:31.877666 3037 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1013 02:47:31.877916 3037 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1013 02:47:31.878153 3037 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1013 02:47:31.884375 3037 target.go:111] Terraform output is in /tmp/test2781687309/out --- PASS: TestMinimalGossipIRSA (0.97s) === RUN TestMinimalGCE I1013 02:47:31.890152 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:31.891919 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:33.327400 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:33.327469 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:33.327555 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1013 02:47:33.327579 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1013 02:47:33.327594 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1013 02:47:33.327636 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:47:33.328560 3037 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1013 02:47:33.334303 3037 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1013 02:47:33.337762 3037 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1013 02:47:33.338380 3037 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1013 02:47:33.338575 3037 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1013 02:47:33.340468 3037 target.go:111] Terraform output is in /tmp/test568508640/out --- PASS: TestMinimalGCE (1.45s) === RUN TestMinimalGCEPrivate I1013 02:47:33.342476 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:33.343464 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:34.723857 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:34.723961 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:34.724122 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W1013 02:47:34.724159 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W1013 02:47:34.724186 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W1013 02:47:34.724254 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:47:34.725736 3037 executor.go:111] Tasks: 0 done / 65 total; 41 can run I1013 02:47:34.730029 3037 executor.go:111] Tasks: 41 done / 65 total; 17 can run I1013 02:47:34.735681 3037 executor.go:111] Tasks: 58 done / 65 total; 5 can run I1013 02:47:34.736668 3037 executor.go:111] Tasks: 63 done / 65 total; 2 can run I1013 02:47:34.736880 3037 executor.go:111] Tasks: 65 done / 65 total; 0 can run I1013 02:47:34.742127 3037 target.go:111] Terraform output is in /tmp/test740574362/out --- PASS: TestMinimalGCEPrivate (1.40s) === RUN TestMinimalGCEInternalLoadBalancer I1013 02:47:34.745316 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:34.746386 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:36.092919 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:36.093019 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:36.093161 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W1013 02:47:36.093196 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W1013 02:47:36.093224 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W1013 02:47:36.093294 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1013 02:47:36.093348 3037 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1013 02:47:36.095116 3037 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1013 02:47:36.099460 3037 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1013 02:47:36.100988 3037 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1013 02:47:36.101441 3037 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1013 02:47:36.107601 3037 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1013 02:47:36.108296 3037 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1013 02:47:36.108415 3037 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1013 02:47:36.108624 3037 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1013 02:47:36.108787 3037 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1013 02:47:36.110910 3037 target.go:111] Terraform output is in /tmp/test1240348593/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.37s) === RUN TestMinimalGCEPublicLoadBalancer I1013 02:47:36.112875 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:36.114099 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:37.261985 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:37.262051 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:37.262138 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W1013 02:47:37.262161 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W1013 02:47:37.262178 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W1013 02:47:37.262219 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:47:37.263240 3037 executor.go:111] Tasks: 0 done / 71 total; 43 can run I1013 02:47:37.268736 3037 executor.go:111] Tasks: 43 done / 71 total; 19 can run I1013 02:47:37.272284 3037 executor.go:111] Tasks: 62 done / 71 total; 7 can run I1013 02:47:37.273019 3037 executor.go:111] Tasks: 69 done / 71 total; 2 can run I1013 02:47:37.273190 3037 executor.go:111] Tasks: 71 done / 71 total; 0 can run I1013 02:47:37.276457 3037 target.go:111] Terraform output is in /tmp/test1028846347/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.17s) === RUN TestMinimalGCELongClusterName I1013 02:47:37.279438 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:37.281234 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:38.435362 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:38.435458 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:38.435558 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1013 02:47:38.435579 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1013 02:47:38.435595 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1013 02:47:38.435639 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:47:38.436521 3037 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1013 02:47:38.439526 3037 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1013 02:47:38.444419 3037 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1013 02:47:38.445363 3037 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1013 02:47:38.445529 3037 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1013 02:47:38.448435 3037 target.go:111] Terraform output is in /tmp/test1666100396/out --- PASS: TestMinimalGCELongClusterName (1.17s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I1013 02:47:38.451241 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:38.452983 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:39.746771 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:39.746822 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:39.746900 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1013 02:47:39.746918 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1013 02:47:39.746930 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1013 02:47:39.746964 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1013 02:47:39.746990 3037 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1013 02:47:39.747797 3037 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1013 02:47:39.750103 3037 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1013 02:47:39.751423 3037 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1013 02:47:39.751740 3037 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1013 02:47:39.756383 3037 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1013 02:47:39.757020 3037 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1013 02:47:39.757147 3037 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1013 02:47:39.757255 3037 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1013 02:47:39.757364 3037 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1013 02:47:39.759498 3037 target.go:111] Terraform output is in /tmp/test4221592412/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.31s) === RUN TestMinimalGCEDNSNone I1013 02:47:39.761394 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:39.762488 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:41.070545 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:41.070603 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:41.070680 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1013 02:47:41.070698 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1013 02:47:41.070721 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1013 02:47:41.070756 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1013 02:47:41.070779 3037 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1013 02:47:41.071566 3037 executor.go:111] Tasks: 0 done / 72 total; 41 can run I1013 02:47:41.073877 3037 executor.go:111] Tasks: 41 done / 72 total; 18 can run I1013 02:47:41.074824 3037 executor.go:111] Tasks: 59 done / 72 total; 2 can run I1013 02:47:41.075016 3037 executor.go:111] Tasks: 61 done / 72 total; 2 can run I1013 02:47:41.079628 3037 executor.go:111] Tasks: 63 done / 72 total; 4 can run I1013 02:47:41.080234 3037 executor.go:111] Tasks: 67 done / 72 total; 2 can run I1013 02:47:41.080345 3037 executor.go:111] Tasks: 69 done / 72 total; 1 can run I1013 02:47:41.080456 3037 executor.go:111] Tasks: 70 done / 72 total; 2 can run I1013 02:47:41.080570 3037 executor.go:111] Tasks: 72 done / 72 total; 0 can run I1013 02:47:41.083239 3037 target.go:111] Terraform output is in /tmp/test1152482920/out --- PASS: TestMinimalGCEDNSNone (1.32s) === RUN TestMinimalScaleway I1013 02:47:41.085452 3037 featureflag.go:164] FeatureFlag "Scaleway"=true I1013 02:47:41.085477 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:42.298240 3037 executor.go:111] Tasks: 0 done / 49 total; 37 can run I1013 02:47:42.299943 3037 executor.go:111] Tasks: 37 done / 49 total; 6 can run I1013 02:47:42.303001 3037 executor.go:111] Tasks: 43 done / 49 total; 6 can run I1013 02:47:42.303601 3037 executor.go:111] Tasks: 49 done / 49 total; 0 can run I1013 02:47:42.305152 3037 target.go:111] Terraform output is in /tmp/test3784291152/out I1013 02:47:42.308079 3037 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.22s) === RUN TestHA I1013 02:47:42.308266 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.308949 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:42.308976 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:42.309002 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:42.309021 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:42.309048 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:42.309096 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:42.309109 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:42.309127 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:42.309140 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:42.323791 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:42.325436 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:42.325479 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:42.325505 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:42.325546 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.087701 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:43.234332 3037 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1013 02:47:43.236143 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:43.236195 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:43.236489 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:43.241553 3037 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1013 02:47:43.247849 3037 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1013 02:47:43.248208 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.248394 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.248563 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.248622 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.248789 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.248937 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.248992 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.249071 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:43.249139 3037 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1013 02:47:43.249400 3037 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1013 02:47:43.249659 3037 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1013 02:47:43.256555 3037 target.go:111] Terraform output is in /tmp/test3127613985/out --- PASS: TestHA (0.95s) === RUN TestHighAvailabilityGCE I1013 02:47:43.261842 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:43.263933 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:47:44.424222 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:47:44.424299 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:47:44.424379 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W1013 02:47:44.424400 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W1013 02:47:44.424415 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W1013 02:47:44.424456 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1013 02:47:44.424503 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1013 02:47:44.424546 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:47:44.425671 3037 executor.go:111] Tasks: 0 done / 82 total; 49 can run I1013 02:47:44.428230 3037 executor.go:111] Tasks: 49 done / 82 total; 19 can run I1013 02:47:44.433593 3037 executor.go:111] Tasks: 68 done / 82 total; 8 can run I1013 02:47:44.444353 3037 executor.go:111] Tasks: 76 done / 82 total; 6 can run I1013 02:47:44.445002 3037 executor.go:111] Tasks: 82 done / 82 total; 0 can run I1013 02:47:44.449985 3037 target.go:111] Terraform output is in /tmp/test1855632384/out --- PASS: TestHighAvailabilityGCE (1.19s) === RUN TestComplex I1013 02:47:44.452529 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:44.452615 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:44.452645 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:44.452706 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:44.452733 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:44.452764 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:44.452791 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:44.452809 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:44.452832 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:44.452849 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:44.471911 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:47:44.474800 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:44.474865 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:45.531485 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:45.679164 3037 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1013 02:47:45.680064 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:45.680085 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:45.680154 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:45.685153 3037 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1013 02:47:45.686997 3037 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1013 02:47:45.687491 3037 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1013 02:47:45.687674 3037 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1013 02:47:45.687712 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:45.687775 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:45.687866 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:45.687913 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:45.693346 3037 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1013 02:47:45.693527 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:45.693717 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:45.694015 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:45.694078 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:45.694126 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:47:45.694292 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:47:45.694483 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1013 02:47:45.698358 3037 target.go:111] Terraform output is in /tmp/test1578832918/out I1013 02:47:45.736064 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:45.736161 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:45.736198 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:45.736233 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:45.736259 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:45.736295 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:45.736323 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:45.736341 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:45.736367 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:45.736386 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:45.755592 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:47:45.758010 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:45.758070 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:46.516871 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:46.658671 3037 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1013 02:47:46.659266 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:46.659300 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:46.659366 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:46.660732 3037 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1013 02:47:46.662544 3037 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1013 02:47:46.663057 3037 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1013 02:47:46.663225 3037 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1013 02:47:46.663260 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:46.663303 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:46.663317 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:46.663361 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:46.666537 3037 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1013 02:47:46.666645 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:46.666744 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:46.667088 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:46.667144 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:46.667193 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:47:46.667384 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:47:46.667593 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1013 02:47:46.675047 3037 target.go:111] Terraform output is in /tmp/test3163772791/out --- PASS: TestComplex (2.22s) === RUN TestCompress I1013 02:47:46.677580 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:46.677664 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:46.677693 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:46.677724 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:46.677751 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:46.677784 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:46.677840 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:46.677857 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:46.677880 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:46.677899 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:46.692622 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:46.694511 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:46.694570 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:47.635317 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:47.779257 3037 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1013 02:47:47.779611 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:47.779634 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:47.779725 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:47.781407 3037 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1013 02:47:47.788102 3037 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1013 02:47:47.788481 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:47.788640 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:47.789123 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:47.789516 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:47.789584 3037 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1013 02:47:47.789751 3037 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1013 02:47:47.789974 3037 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1013 02:47:47.792922 3037 target.go:111] Terraform output is in /tmp/test430295839/out --- PASS: TestCompress (1.12s) === RUN TestExternalPolicies I1013 02:47:47.795825 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:47.795910 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:47.795939 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:47.795970 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:47.795995 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:47.796027 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:47.796076 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:47.796093 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:47.796118 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:47.796135 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:47.812542 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:47.814632 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:47.814690 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:48.576153 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:48.712573 3037 executor.go:111] Tasks: 0 done / 115 total; 47 can run I1013 02:47:48.714737 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:48.714768 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:48.714858 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:48.718589 3037 executor.go:111] Tasks: 47 done / 115 total; 22 can run I1013 02:47:48.720467 3037 executor.go:111] Tasks: 69 done / 115 total; 30 can run I1013 02:47:48.720891 3037 executor.go:111] Tasks: 99 done / 115 total; 4 can run W1013 02:47:48.721029 3037 api.go:53] PageSize not implemented W1013 02:47:48.721134 3037 api.go:53] PageSize not implemented I1013 02:47:48.724757 3037 executor.go:111] Tasks: 103 done / 115 total; 4 can run I1013 02:47:48.724856 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:48.725001 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:48.725120 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:48.725582 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:48.725669 3037 executor.go:111] Tasks: 107 done / 115 total; 2 can run I1013 02:47:48.725886 3037 executor.go:111] Tasks: 109 done / 115 total; 6 can run I1013 02:47:48.726076 3037 executor.go:111] Tasks: 115 done / 115 total; 0 can run I1013 02:47:48.731080 3037 target.go:111] Terraform output is in /tmp/test1872741047/out --- PASS: TestExternalPolicies (0.94s) === RUN TestMinimalIPv6 I1013 02:47:48.734648 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:48.734749 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:48.734784 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:48.734825 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:48.734860 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:48.734902 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:48.734976 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:48.735004 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:48.735042 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:48.735068 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:48.755040 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:48.760404 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:48.760495 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:49.519608 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:49.676660 3037 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1013 02:47:49.677514 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:49.677539 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:49.677601 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:49.680349 3037 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1013 02:47:49.682795 3037 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1013 02:47:49.683368 3037 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1013 02:47:49.683809 3037 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1013 02:47:49.683887 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:49.683970 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:49.684109 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:49.684177 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:49.689467 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:47:49.689622 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:49.689763 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:49.690274 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:49.690394 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:49.690516 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:47:49.690849 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:47:49.691190 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:47:49.697707 3037 target.go:111] Terraform output is in /tmp/test2988887205/out --- PASS: TestMinimalIPv6 (0.97s) === RUN TestMinimalIPv6Calico I1013 02:47:49.703040 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:49.703270 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:49.703346 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:49.703463 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:49.703562 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:49.704341 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:49.704452 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:49.704504 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:49.704580 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:49.704627 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:49.733235 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:49.736979 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:49.737074 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:50.684484 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:51.094543 3037 executor.go:111] Tasks: 0 done / 138 total; 47 can run I1013 02:47:51.094844 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:51.094881 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:51.094985 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:51.097805 3037 executor.go:111] Tasks: 47 done / 138 total; 25 can run I1013 02:47:51.099652 3037 executor.go:111] Tasks: 72 done / 138 total; 37 can run I1013 02:47:51.100122 3037 executor.go:111] Tasks: 109 done / 138 total; 9 can run I1013 02:47:51.100549 3037 executor.go:111] Tasks: 118 done / 138 total; 8 can run I1013 02:47:51.100696 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:51.100787 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:51.100889 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:51.100942 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:51.104707 3037 executor.go:111] Tasks: 126 done / 138 total; 4 can run I1013 02:47:51.104855 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:51.105031 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:51.105184 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:51.105683 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:51.105777 3037 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1013 02:47:51.106015 3037 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1013 02:47:51.106220 3037 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1013 02:47:51.111014 3037 target.go:111] Terraform output is in /tmp/test3306958358/out --- PASS: TestMinimalIPv6Calico (1.41s) === RUN TestMinimalIPv6Cilium I1013 02:47:51.115355 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:51.115450 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:51.115486 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:51.115519 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:51.115544 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:51.115577 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:51.115629 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:51.115646 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:51.115671 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:51.115688 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:51.142348 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:51.145542 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:51.145617 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:52.089681 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:52.251068 3037 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1013 02:47:52.263595 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:52.263633 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:52.263810 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:52.265840 3037 executor.go:111] Tasks: 47 done / 137 total; 25 can run I1013 02:47:52.268146 3037 executor.go:111] Tasks: 72 done / 137 total; 36 can run I1013 02:47:52.269137 3037 executor.go:111] Tasks: 108 done / 137 total; 9 can run I1013 02:47:52.269406 3037 executor.go:111] Tasks: 117 done / 137 total; 8 can run I1013 02:47:52.269498 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:52.269552 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:52.269644 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:52.269714 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:52.273747 3037 executor.go:111] Tasks: 125 done / 137 total; 4 can run I1013 02:47:52.273900 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:52.274068 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:52.274241 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:52.274527 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:52.274590 3037 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1013 02:47:52.274768 3037 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1013 02:47:52.274976 3037 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1013 02:47:52.281732 3037 target.go:111] Terraform output is in /tmp/test148056645/out --- PASS: TestMinimalIPv6Cilium (1.17s) === RUN TestMinimalIPv6NoSubnetPrefix I1013 02:47:52.286151 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:52.286273 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:52.286315 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:52.286361 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:52.286408 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:52.286463 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:52.286546 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:52.286578 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:52.286618 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:52.286647 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:52.305834 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:52.308258 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:52.308320 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:53.253035 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:53.383327 3037 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1013 02:47:53.384077 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:53.384099 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:53.384155 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:53.385311 3037 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1013 02:47:53.387204 3037 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1013 02:47:53.387739 3037 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1013 02:47:53.387977 3037 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1013 02:47:53.388037 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:53.388087 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:53.388171 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:47:53.388210 3037 loadbalancers.go:35] PageSize not implemented I1013 02:47:53.391134 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:47:53.391242 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:53.391385 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:53.391474 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:53.391878 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:53.391978 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:47:53.392179 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:47:53.392389 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:47:53.396250 3037 target.go:111] Terraform output is in /tmp/test1410149311/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.11s) === RUN TestMinimalWarmPool I1013 02:47:53.398979 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:53.399071 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:53.399104 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:53.399167 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:53.399193 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:53.399226 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:53.399253 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:53.399271 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:53.399297 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:53.399314 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:53.417400 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:53.419417 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:53.419476 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:54.179234 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.341589 3037 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1013 02:47:54.342017 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:54.342047 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:54.342117 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:54.343950 3037 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1013 02:47:54.349620 3037 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1013 02:47:54.349767 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:54.350053 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:54.350336 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:54.350373 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:54.350464 3037 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1013 02:47:54.350676 3037 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1013 02:47:54.350935 3037 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1013 02:47:54.354066 3037 target.go:111] Terraform output is in /tmp/test953338767/out --- PASS: TestMinimalWarmPool (0.96s) === RUN TestMinimalEtcd I1013 02:47:54.356704 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:54.356787 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:54.356814 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:54.356843 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:54.356870 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:54.356902 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:54.356953 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:54.356972 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:54.356995 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:54.357013 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:54.372653 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:54.374564 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:54.374620 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:55.135263 3037 zones.go:93] ListHostedZonesPages { } W1013 02:47:55.249046 3037 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W1013 02:47:55.249087 3037 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W1013 02:47:55.250687 3037 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I1013 02:47:55.258666 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:47:55.259391 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:55.259424 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:55.259497 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:55.260765 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:47:55.264123 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:47:55.264281 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:55.264503 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:55.264642 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:55.265191 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:55.265293 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:47:55.265522 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:47:55.265756 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:47:55.268740 3037 target.go:111] Terraform output is in /tmp/test2793613267/out --- PASS: TestMinimalEtcd (0.91s) === RUN TestMinimalGp3 I1013 02:47:55.271252 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:55.271331 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:55.271355 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:55.271384 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:55.271411 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:55.271444 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:55.271493 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:55.271510 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:55.271533 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:55.271550 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:55.288774 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:55.290594 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:55.290650 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:56.050992 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:56.236771 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:47:56.237466 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:56.237503 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:56.237594 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:56.239355 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:47:56.245725 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:47:56.245988 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:56.246116 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:56.246464 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:56.247122 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:56.247274 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:47:56.248028 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:47:56.248757 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:47:56.255802 3037 target.go:111] Terraform output is in /tmp/test2543989874/out --- PASS: TestMinimalGp3 (0.99s) === RUN TestMinimalLongClusterName I1013 02:47:56.260351 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:56.260492 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:56.260536 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:56.260589 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:56.260630 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:56.260679 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:56.260773 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:56.260808 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:56.260845 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:56.260872 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:56.283689 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:56.285595 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:56.285652 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1013 02:47:57.047562 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:57.176512 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:47:57.176803 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:57.176841 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:57.176910 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:57.178796 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:47:57.186202 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:47:57.186928 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.187359 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.188566 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.188646 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.188770 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:47:57.189044 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:47:57.189270 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:47:57.194707 3037 target.go:111] Terraform output is in /tmp/test1290950062/out --- PASS: TestMinimalLongClusterName (0.94s) === RUN TestExistingSG I1013 02:47:57.199501 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:57.199633 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:57.199678 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:57.199728 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:57.199777 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:57.199834 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:57.199922 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:57.199957 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:57.199998 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:57.200029 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:57.235131 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:57.238934 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.239016 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.239077 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.239137 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:57.996359 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:58.124125 3037 executor.go:111] Tasks: 0 done / 163 total; 53 can run I1013 02:47:58.127529 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:58.127578 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:58.127684 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:58.131016 3037 executor.go:111] Tasks: 53 done / 163 total; 26 can run I1013 02:47:58.132748 3037 executor.go:111] Tasks: 79 done / 163 total; 54 can run I1013 02:47:58.133435 3037 executor.go:111] Tasks: 133 done / 163 total; 6 can run W1013 02:47:58.133489 3037 api.go:53] PageSize not implemented W1013 02:47:58.133508 3037 api.go:53] PageSize not implemented W1013 02:47:58.133597 3037 api.go:53] PageSize not implemented W1013 02:47:58.133684 3037 api.go:53] PageSize not implemented I1013 02:47:58.136855 3037 executor.go:111] Tasks: 139 done / 163 total; 8 can run I1013 02:47:58.136969 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137050 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137147 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137324 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137420 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137491 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137548 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137611 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.137683 3037 executor.go:111] Tasks: 147 done / 163 total; 4 can run I1013 02:47:58.137952 3037 executor.go:111] Tasks: 151 done / 163 total; 12 can run I1013 02:47:58.138162 3037 executor.go:111] Tasks: 163 done / 163 total; 0 can run I1013 02:47:58.143047 3037 target.go:111] Terraform output is in /tmp/test1065651784/out --- PASS: TestExistingSG (0.95s) === RUN TestBastionAdditionalUserData I1013 02:47:58.149213 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:58.149308 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:58.149340 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:58.149373 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:58.149400 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:58.149433 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:58.149492 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:58.149510 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:58.149540 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:58.149571 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:58.166490 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:47:58.168490 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.168548 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:58.168583 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.126798 3037 zones.go:93] ListHostedZonesPages { } I1013 02:47:59.263149 3037 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1013 02:47:59.264136 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:47:59.264179 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:47:59.264266 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:47:59.266664 3037 executor.go:111] Tasks: 47 done / 137 total; 30 can run I1013 02:47:59.269757 3037 executor.go:111] Tasks: 77 done / 137 total; 35 can run I1013 02:47:59.270463 3037 executor.go:111] Tasks: 112 done / 137 total; 6 can run W1013 02:47:59.270520 3037 api.go:53] PageSize not implemented W1013 02:47:59.270629 3037 api.go:53] PageSize not implemented W1013 02:47:59.270755 3037 api.go:53] PageSize not implemented I1013 02:47:59.276263 3037 executor.go:111] Tasks: 118 done / 137 total; 7 can run I1013 02:47:59.276428 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.276578 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.276723 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.276927 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.277814 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.278285 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.278767 3037 executor.go:111] Tasks: 125 done / 137 total; 3 can run I1013 02:47:59.279915 3037 executor.go:111] Tasks: 128 done / 137 total; 9 can run I1013 02:47:59.280760 3037 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1013 02:47:59.285907 3037 target.go:111] Terraform output is in /tmp/test4171387898/out --- PASS: TestBastionAdditionalUserData (1.14s) === RUN TestPrivateFlannel I1013 02:47:59.288733 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:59.288813 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:59.288842 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:59.288900 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:59.288926 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:59.288961 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:59.288987 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:59.289006 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:59.289031 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:59.289048 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:59.305433 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:47:59.307395 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.307448 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:47:59.307484 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.070043 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:00.231415 3037 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1013 02:48:00.232123 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:00.232158 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:00.232234 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:00.234406 3037 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1013 02:48:00.237048 3037 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1013 02:48:00.237363 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.237507 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.237766 3037 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1013 02:48:00.237826 3037 api.go:53] PageSize not implemented W1013 02:48:00.237928 3037 api.go:53] PageSize not implemented I1013 02:48:00.243520 3037 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1013 02:48:00.243844 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.244094 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.244564 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.244632 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.244735 3037 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1013 02:48:00.245018 3037 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1013 02:48:00.245383 3037 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1013 02:48:00.252019 3037 target.go:111] Terraform output is in /tmp/test307881079/out --- PASS: TestPrivateFlannel (0.97s) === RUN TestPrivateCalico I1013 02:48:00.256896 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:00.257028 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:00.257070 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:00.257116 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:00.257157 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:00.257206 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:00.257284 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:00.257316 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:00.257355 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:00.257399 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:00.290697 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:48:00.294141 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.294219 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:00.294270 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.306942 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:01.660337 3037 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1013 02:48:01.660821 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:01.660848 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:01.660952 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:01.662446 3037 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1013 02:48:01.664411 3037 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1013 02:48:01.664661 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.664766 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.665105 3037 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1013 02:48:01.665189 3037 api.go:53] PageSize not implemented W1013 02:48:01.665213 3037 api.go:53] PageSize not implemented I1013 02:48:01.668274 3037 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1013 02:48:01.668447 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.668636 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.668858 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.668945 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.669014 3037 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1013 02:48:01.669174 3037 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1013 02:48:01.669351 3037 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1013 02:48:01.675564 3037 target.go:111] Terraform output is in /tmp/test1086514934/out --- PASS: TestPrivateCalico (1.42s) === RUN TestPrivateCilium I1013 02:48:01.679928 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:01.680031 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:01.680063 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:01.680101 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:01.680139 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:01.680180 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:01.680251 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:01.680278 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:01.680313 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:01.680338 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:01.704939 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:01.707126 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.707178 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:01.707213 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.474062 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:02.650397 3037 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1013 02:48:02.651243 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:02.651276 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:02.651375 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:02.653095 3037 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1013 02:48:02.656290 3037 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1013 02:48:02.656860 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.656965 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.657031 3037 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1013 02:48:02.657163 3037 api.go:53] PageSize not implemented W1013 02:48:02.657213 3037 api.go:53] PageSize not implemented I1013 02:48:02.662809 3037 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1013 02:48:02.662999 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.663217 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.663454 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.663972 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.664107 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:48:02.664367 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:48:02.664678 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:48:02.671365 3037 target.go:111] Terraform output is in /tmp/test1273461553/out --- PASS: TestPrivateCilium (1.00s) === RUN TestPrivateCilium2 I1013 02:48:02.676135 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:02.676262 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:02.676304 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:02.676355 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:02.676397 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:02.676446 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:02.676531 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:02.676565 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:02.676607 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:02.676637 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:02.706839 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:48:02.710755 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.710818 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:02.710852 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:03.461554 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:04.042919 3037 executor.go:111] Tasks: 0 done / 138 total; 50 can run I1013 02:48:04.043936 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:04.043970 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:04.044091 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:04.046582 3037 executor.go:111] Tasks: 50 done / 138 total; 30 can run I1013 02:48:04.049779 3037 executor.go:111] Tasks: 80 done / 138 total; 36 can run I1013 02:48:04.050223 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.050331 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.050477 3037 executor.go:111] Tasks: 116 done / 138 total; 6 can run W1013 02:48:04.050534 3037 api.go:53] PageSize not implemented W1013 02:48:04.050725 3037 api.go:53] PageSize not implemented I1013 02:48:04.056457 3037 executor.go:111] Tasks: 122 done / 138 total; 8 can run I1013 02:48:04.056729 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.056940 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.057417 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.057511 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.057584 3037 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1013 02:48:04.057939 3037 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1013 02:48:04.058298 3037 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1013 02:48:04.068408 3037 target.go:111] Terraform output is in /tmp/test2067735522/out --- PASS: TestPrivateCilium2 (1.40s) === RUN TestPrivateCiliumAdvanced I1013 02:48:04.073419 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:04.073516 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:04.073546 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:04.073576 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:04.073603 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:04.073635 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:04.073690 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:04.073707 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:04.073731 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:04.073750 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:04.092916 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:04.095127 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.095179 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.095215 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:04.854002 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:05.024370 3037 executor.go:111] Tasks: 0 done / 142 total; 54 can run I1013 02:48:05.025053 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:05.025083 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:05.025150 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:05.027946 3037 executor.go:111] Tasks: 54 done / 142 total; 30 can run I1013 02:48:05.031433 3037 executor.go:111] Tasks: 84 done / 142 total; 36 can run I1013 02:48:05.031992 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.032153 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.032256 3037 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1013 02:48:05.032354 3037 api.go:53] PageSize not implemented W1013 02:48:05.032458 3037 api.go:53] PageSize not implemented I1013 02:48:05.036101 3037 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1013 02:48:05.036367 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.036470 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.036765 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.037017 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.037134 3037 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1013 02:48:05.037386 3037 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1013 02:48:05.038485 3037 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1013 02:48:05.046351 3037 target.go:111] Terraform output is in /tmp/test1778303870/out --- PASS: TestPrivateCiliumAdvanced (0.98s) === RUN TestPrivateCiliumENI I1013 02:48:05.049277 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:05.049355 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:05.049380 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:05.049412 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:05.049437 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:05.049469 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:05.049520 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:05.049536 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:05.049561 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:05.049578 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:05.065363 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:05.067417 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.067470 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.067507 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:05.824325 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:06.031804 3037 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1013 02:48:06.032979 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:06.033020 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:06.033125 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:06.034611 3037 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1013 02:48:06.036626 3037 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1013 02:48:06.037033 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.037234 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.037347 3037 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1013 02:48:06.037422 3037 api.go:53] PageSize not implemented W1013 02:48:06.037542 3037 api.go:53] PageSize not implemented I1013 02:48:06.043204 3037 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1013 02:48:06.043431 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.043653 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.044130 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.044209 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.044315 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:48:06.044643 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:48:06.045002 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:48:06.055790 3037 target.go:111] Terraform output is in /tmp/test3591864606/out --- PASS: TestPrivateCiliumENI (1.01s) === RUN TestPrivateCanal I1013 02:48:06.060603 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:06.060753 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:06.060803 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:06.060900 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:06.060948 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:06.061000 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:06.061044 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:06.061077 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:06.061119 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:06.061148 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:06.088560 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:48:06.091500 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.091574 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:06.091624 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.044755 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:07.422398 3037 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1013 02:48:07.423526 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:07.423571 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:07.423684 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:07.425982 3037 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1013 02:48:07.428065 3037 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1013 02:48:07.428509 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.428672 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.428781 3037 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1013 02:48:07.428840 3037 api.go:53] PageSize not implemented W1013 02:48:07.429027 3037 api.go:53] PageSize not implemented I1013 02:48:07.432250 3037 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1013 02:48:07.432389 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.432589 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.432803 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.433359 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.433468 3037 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1013 02:48:07.433756 3037 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1013 02:48:07.434121 3037 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1013 02:48:07.438474 3037 target.go:111] Terraform output is in /tmp/test2500322787/out --- PASS: TestPrivateCanal (1.39s) === RUN TestPrivateKopeio I1013 02:48:07.446677 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:07.446773 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:07.446809 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:07.446843 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:07.446869 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:07.446907 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:07.446968 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:07.446989 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:07.447012 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:07.447035 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:07.463980 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:07.466023 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.466083 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:07.466123 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.424782 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:08.589955 3037 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1013 02:48:08.590985 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:08.591015 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:08.591108 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:08.593477 3037 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1013 02:48:08.598705 3037 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1013 02:48:08.599492 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.599661 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.599816 3037 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1013 02:48:08.599950 3037 api.go:53] PageSize not implemented W1013 02:48:08.600077 3037 api.go:53] PageSize not implemented I1013 02:48:08.605741 3037 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1013 02:48:08.606022 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.606122 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.606620 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.606708 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.606898 3037 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1013 02:48:08.607272 3037 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1013 02:48:08.607611 3037 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1013 02:48:08.614595 3037 target.go:111] Terraform output is in /tmp/test3844828046/out --- PASS: TestPrivateKopeio (1.17s) === RUN TestUnmanaged I1013 02:48:08.619442 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:08.619602 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:08.619646 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:08.619690 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:08.619752 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:08.619820 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:08.619929 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:08.619966 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:08.620021 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:08.620053 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:08.650133 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:08.653375 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.653454 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:08.653514 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.414111 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:09.578614 3037 executor.go:111] Tasks: 0 done / 126 total; 46 can run I1013 02:48:09.581892 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:09.581930 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:09.582061 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:09.585646 3037 executor.go:111] Tasks: 46 done / 126 total; 27 can run I1013 02:48:09.589001 3037 executor.go:111] Tasks: 73 done / 126 total; 33 can run I1013 02:48:09.589498 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.589613 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.589683 3037 executor.go:111] Tasks: 106 done / 126 total; 5 can run W1013 02:48:09.589713 3037 api.go:53] PageSize not implemented W1013 02:48:09.589781 3037 api.go:53] PageSize not implemented I1013 02:48:09.595607 3037 executor.go:111] Tasks: 111 done / 126 total; 7 can run I1013 02:48:09.595817 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.596106 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.596495 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.597013 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.597128 3037 executor.go:111] Tasks: 118 done / 126 total; 2 can run I1013 02:48:09.597883 3037 executor.go:111] Tasks: 120 done / 126 total; 6 can run I1013 02:48:09.598228 3037 executor.go:111] Tasks: 126 done / 126 total; 0 can run I1013 02:48:09.604864 3037 target.go:111] Terraform output is in /tmp/test1572677780/out --- PASS: TestUnmanaged (0.99s) === RUN TestPrivateSharedSubnet I1013 02:48:09.609648 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:09.609789 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:09.609833 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:09.609887 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:09.609934 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:09.609985 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:09.610072 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:09.610104 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:09.610144 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:09.610173 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:09.638767 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:09.643959 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.644177 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:09.644302 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.401545 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:10.582311 3037 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1013 02:48:10.583350 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:10.583383 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:10.583440 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:10.585704 3037 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1013 02:48:10.586125 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:10.587739 3037 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1013 02:48:10.588074 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.588288 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.588397 3037 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1013 02:48:10.588517 3037 api.go:53] PageSize not implemented W1013 02:48:10.588590 3037 api.go:53] PageSize not implemented I1013 02:48:10.594244 3037 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1013 02:48:10.594402 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.594610 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.594901 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.595092 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.595195 3037 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1013 02:48:10.595435 3037 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1013 02:48:10.595722 3037 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1013 02:48:10.602398 3037 target.go:111] Terraform output is in /tmp/test3702448046/out --- PASS: TestPrivateSharedSubnet (1.00s) === RUN TestPrivateSharedIP I1013 02:48:10.607024 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:10.607150 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:10.607191 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:10.607237 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:10.607276 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:10.607329 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:10.607430 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:10.607462 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:10.607499 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:10.607525 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:10.640031 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:10.643985 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.644100 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:10.644164 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.645322 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:11.814212 3037 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1013 02:48:11.815032 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:11.815055 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:11.815110 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:11.816777 3037 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1013 02:48:11.817334 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:11.819825 3037 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1013 02:48:11.820274 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.820400 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.820531 3037 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1013 02:48:11.820570 3037 api.go:53] PageSize not implemented W1013 02:48:11.820789 3037 api.go:53] PageSize not implemented I1013 02:48:11.823754 3037 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1013 02:48:11.824122 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.824445 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.824704 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.825116 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.825221 3037 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1013 02:48:11.825516 3037 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1013 02:48:11.825827 3037 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1013 02:48:11.834874 3037 target.go:111] Terraform output is in /tmp/test2282532110/out --- PASS: TestPrivateSharedIP (1.23s) === RUN TestPrivateDns1 I1013 02:48:11.839646 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:11.839788 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:11.839832 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:11.839881 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:11.839929 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:11.839981 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:11.840065 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:11.840096 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:11.840132 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:11.840162 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1013 02:48:11.879840 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.879926 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:11.879992 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.859451 3037 executor.go:111] Tasks: 0 done / 135 total; 46 can run I1013 02:48:12.862302 3037 executor.go:111] Tasks: 46 done / 135 total; 28 can run I1013 02:48:12.862635 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I1013 02:48:12.862680 3037 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I1013 02:48:12.862793 3037 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I1013 02:48:12.862812 3037 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I1013 02:48:12.863152 3037 executor.go:111] Tasks: 74 done / 135 total; 39 can run I1013 02:48:12.863777 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.863962 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.870320 3037 executor.go:111] Tasks: 113 done / 135 total; 6 can run W1013 02:48:12.870514 3037 api.go:53] PageSize not implemented W1013 02:48:12.870635 3037 api.go:53] PageSize not implemented I1013 02:48:12.876168 3037 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1013 02:48:12.876329 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.876456 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.876633 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.877189 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.877295 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:48:12.877557 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:48:12.877804 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1013 02:48:12.885133 3037 target.go:111] Terraform output is in /tmp/test1506320486/out --- PASS: TestPrivateDns1 (1.05s) === RUN TestPrivateDns2 I1013 02:48:12.889872 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:12.890024 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:12.890069 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:12.890128 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:12.890178 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:12.890242 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:12.890345 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:12.890387 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:12.890455 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:12.890500 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:12.921310 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.921368 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:12.921411 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.818051 3037 executor.go:111] Tasks: 0 done / 132 total; 45 can run I1013 02:48:13.821098 3037 executor.go:111] Tasks: 45 done / 132 total; 26 can run I1013 02:48:13.821418 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I1013 02:48:13.821450 3037 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I1013 02:48:13.821490 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:13.821547 3037 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I1013 02:48:13.821598 3037 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I1013 02:48:13.821669 3037 executor.go:111] Tasks: 71 done / 132 total; 39 can run I1013 02:48:13.821908 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.822066 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.823697 3037 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1013 02:48:13.823877 3037 api.go:53] PageSize not implemented W1013 02:48:13.823933 3037 api.go:53] PageSize not implemented I1013 02:48:13.829407 3037 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1013 02:48:13.829682 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.829849 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.830120 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.830347 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.830459 3037 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1013 02:48:13.830749 3037 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1013 02:48:13.831045 3037 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1013 02:48:13.837441 3037 target.go:111] Terraform output is in /tmp/test3360995234/out --- PASS: TestPrivateDns2 (0.95s) === RUN TestDiscoveryFeatureGate I1013 02:48:13.842026 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:13.842154 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:13.842196 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:13.842287 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:13.842330 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:13.842384 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:13.842426 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:13.842457 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:13.842495 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:13.842523 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:13.868559 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:48:13.871704 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:13.871784 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:14.628309 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:14.813937 3037 executor.go:111] Tasks: 0 done / 113 total; 52 can run I1013 02:48:14.815260 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:14.815295 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:14.815427 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:14.821655 3037 executor.go:111] Tasks: 52 done / 113 total; 28 can run I1013 02:48:14.825042 3037 executor.go:111] Tasks: 80 done / 113 total; 25 can run I1013 02:48:14.825362 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:14.825510 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:14.825760 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:14.825924 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:14.825987 3037 executor.go:111] Tasks: 105 done / 113 total; 2 can run I1013 02:48:14.826327 3037 executor.go:111] Tasks: 107 done / 113 total; 6 can run I1013 02:48:14.826563 3037 executor.go:111] Tasks: 113 done / 113 total; 0 can run I1013 02:48:14.832696 3037 target.go:111] Terraform output is in /tmp/test1111902452/out --- PASS: TestDiscoveryFeatureGate (1.00s) === RUN TestVFSServiceAccountIssuerDiscovery I1013 02:48:14.838360 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:14.838493 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:14.838537 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:14.838585 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:14.838626 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:14.838679 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:14.838764 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:14.838794 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:14.838842 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:14.838871 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:14.864405 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:14.867716 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:14.867801 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:15.870510 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:16.061547 3037 executor.go:111] Tasks: 0 done / 104 total; 47 can run I1013 02:48:16.064707 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:16.064760 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:16.064901 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:16.067159 3037 executor.go:111] Tasks: 47 done / 104 total; 24 can run I1013 02:48:16.071124 3037 executor.go:111] Tasks: 71 done / 104 total; 25 can run I1013 02:48:16.071454 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:16.071732 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:16.071963 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:16.072632 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:16.072772 3037 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1013 02:48:16.073063 3037 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1013 02:48:16.073372 3037 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1013 02:48:16.078794 3037 target.go:111] Terraform output is in /tmp/test2870895628/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.24s) === RUN TestAWSLBController I1013 02:48:16.083423 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:16.083557 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:16.083600 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:16.083651 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:16.083693 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:16.083741 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:16.083825 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:16.083854 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:16.083894 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:16.083922 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:16.112483 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:16.114402 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:16.114459 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:17.390778 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:18.049016 3037 executor.go:111] Tasks: 0 done / 116 total; 54 can run I1013 02:48:18.052791 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:18.052888 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:18.053026 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:18.057105 3037 executor.go:111] Tasks: 54 done / 116 total; 29 can run I1013 02:48:18.062955 3037 executor.go:111] Tasks: 83 done / 116 total; 25 can run I1013 02:48:18.063327 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:18.063494 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:18.063765 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:18.063820 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:18.063887 3037 executor.go:111] Tasks: 108 done / 116 total; 2 can run I1013 02:48:18.064059 3037 executor.go:111] Tasks: 110 done / 116 total; 6 can run I1013 02:48:18.064342 3037 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1013 02:48:18.074780 3037 target.go:111] Terraform output is in /tmp/test2706253471/out --- PASS: TestAWSLBController (2.00s) === RUN TestManyAddons I1013 02:48:18.086606 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:18.086756 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:18.086808 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:18.086859 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:18.086907 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:18.086959 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:18.087048 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:18.087078 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:18.087116 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:18.087145 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:18.117435 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:18.121069 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:18.121161 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:18.875021 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:19.606794 3037 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1013 02:48:19.610518 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:19.610555 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:19.610661 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:19.615465 3037 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1013 02:48:19.621419 3037 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1013 02:48:19.621734 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:19.621981 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:19.622451 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:19.622520 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:19.622639 3037 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1013 02:48:19.622929 3037 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1013 02:48:19.623294 3037 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1013 02:48:19.629468 3037 target.go:111] Terraform output is in /tmp/test3229863667/out --- PASS: TestManyAddons (1.55s) === RUN TestManyAddonsCCMIRSA I1013 02:48:19.640852 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:19.640998 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:19.641048 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:19.641098 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:19.641141 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:19.641190 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:19.641278 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:19.641309 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:19.641349 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:19.641380 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:19.671688 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:19.675341 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:19.675433 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:20.430297 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:21.228840 3037 executor.go:111] Tasks: 0 done / 123 total; 59 can run I1013 02:48:21.232563 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:21.232623 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:21.233038 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:21.237529 3037 executor.go:111] Tasks: 59 done / 123 total; 30 can run I1013 02:48:21.241023 3037 executor.go:111] Tasks: 89 done / 123 total; 26 can run I1013 02:48:21.241402 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:21.241578 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:21.241974 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:21.242043 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:21.242110 3037 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1013 02:48:21.242426 3037 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1013 02:48:21.242691 3037 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1013 02:48:21.250498 3037 target.go:111] Terraform output is in /tmp/test2304567795/out --- PASS: TestManyAddonsCCMIRSA (1.62s) === RUN TestManyAddonsCCMIRSA23 I1013 02:48:21.264245 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:21.264388 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:21.264433 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:21.264482 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:21.264526 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:21.264575 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:21.264658 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:21.264689 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:21.264728 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:21.264756 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:21.294112 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1013 02:48:21.297865 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:21.297951 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:22.047826 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:22.792550 3037 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1013 02:48:22.794250 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:22.794290 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:22.794390 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:22.803349 3037 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1013 02:48:22.806982 3037 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1013 02:48:22.807384 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:22.807544 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:22.807803 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:22.808305 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:22.808466 3037 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1013 02:48:22.808843 3037 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1013 02:48:22.809190 3037 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1013 02:48:22.817140 3037 target.go:111] Terraform output is in /tmp/test1885180127/out --- PASS: TestManyAddonsCCMIRSA23 (1.57s) === RUN TestManyAddonsCCMIRSA24 I1013 02:48:22.832786 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:22.832934 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:22.832981 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:22.833031 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:22.833074 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:22.833125 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:22.833211 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:22.833241 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:22.833279 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:22.833310 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:22.861900 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:48:22.865506 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:22.865588 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:23.619006 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:24.360271 3037 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1013 02:48:24.360633 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:24.360670 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:24.360784 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:24.364671 3037 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1013 02:48:24.372258 3037 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1013 02:48:24.372594 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:24.372706 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:24.373040 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:24.373295 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:24.373423 3037 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1013 02:48:24.373738 3037 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1013 02:48:24.374065 3037 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1013 02:48:24.381875 3037 target.go:111] Terraform output is in /tmp/test3372635884/out --- PASS: TestManyAddonsCCMIRSA24 (1.56s) === RUN TestManyAddonsCCMIRSA25 I1013 02:48:24.391376 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:24.391525 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:24.391573 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:24.391617 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:24.391663 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:24.391718 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:24.391804 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:24.391835 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:24.391875 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:24.391903 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:24.418961 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:48:24.423151 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:24.423273 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:25.182588 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:25.943279 3037 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1013 02:48:25.944511 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:25.944537 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:25.944655 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:25.946761 3037 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1013 02:48:25.954484 3037 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1013 02:48:25.955337 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:25.956581 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:25.957048 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:25.957468 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:25.957642 3037 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1013 02:48:25.958014 3037 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1013 02:48:25.958345 3037 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1013 02:48:25.966754 3037 target.go:111] Terraform output is in /tmp/test3509742889/out --- PASS: TestManyAddonsCCMIRSA25 (1.59s) === RUN TestManyAddonsCCMIRSA26 I1013 02:48:25.978112 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:25.978227 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:25.978271 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:25.978317 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:25.978356 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:25.978411 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:25.978497 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:25.978528 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:25.978566 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:25.978595 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:26.004088 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:48:26.006813 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:26.006884 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:27.030383 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:27.864373 3037 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1013 02:48:27.865446 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:27.865499 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:27.865601 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:27.874535 3037 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1013 02:48:27.880524 3037 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1013 02:48:27.880940 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:27.881098 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:27.881771 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:27.881914 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:27.882112 3037 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1013 02:48:27.882564 3037 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1013 02:48:27.882909 3037 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1013 02:48:27.894457 3037 target.go:111] Terraform output is in /tmp/test3848997626/out --- PASS: TestManyAddonsCCMIRSA26 (1.93s) === RUN TestManyAddonsGCE I1013 02:48:27.909746 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:48:29.522485 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:48:29.522554 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:48:29.522629 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W1013 02:48:29.522649 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W1013 02:48:29.522663 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W1013 02:48:29.522703 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:48:29.523635 3037 executor.go:111] Tasks: 0 done / 67 total; 44 can run I1013 02:48:29.531899 3037 executor.go:111] Tasks: 44 done / 67 total; 17 can run I1013 02:48:29.537648 3037 executor.go:111] Tasks: 61 done / 67 total; 4 can run I1013 02:48:29.538809 3037 executor.go:111] Tasks: 65 done / 67 total; 2 can run I1013 02:48:29.538991 3037 executor.go:111] Tasks: 67 done / 67 total; 0 can run I1013 02:48:29.543081 3037 target.go:111] Terraform output is in /tmp/test3665396319/out --- PASS: TestManyAddonsGCE (1.64s) === RUN TestCCM I1013 02:48:29.550609 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:29.550787 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:29.550818 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:29.550916 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:29.550962 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:29.551011 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:29.551054 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:29.551083 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:29.551131 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:29.551163 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:29.583995 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:29.588372 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:29.588466 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:30.348529 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:31.052231 3037 executor.go:111] Tasks: 0 done / 110 total; 51 can run I1013 02:48:31.052742 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:31.052766 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:31.052837 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:31.059677 3037 executor.go:111] Tasks: 51 done / 110 total; 24 can run I1013 02:48:31.063565 3037 executor.go:111] Tasks: 75 done / 110 total; 27 can run I1013 02:48:31.063911 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:31.064063 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:31.064340 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:31.064419 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:31.064483 3037 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1013 02:48:31.064673 3037 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1013 02:48:31.065027 3037 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1013 02:48:31.071532 3037 target.go:111] Terraform output is in /tmp/test1437130319/out --- PASS: TestCCM (1.53s) === RUN TestExternalDNS I1013 02:48:31.080276 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:31.080412 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:31.080456 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:31.080503 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:31.080564 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:31.080621 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:31.080724 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:31.080759 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:31.080807 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:31.080838 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:31.103825 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:31.106876 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:31.107000 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:31.863277 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:32.016558 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:48:32.016738 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:32.016754 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:32.016817 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:32.019248 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:48:32.024666 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:48:32.024827 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.025086 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.025223 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.025482 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.025548 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:48:32.025781 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:48:32.025997 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:32.028982 3037 target.go:111] Terraform output is in /tmp/test2018607070/out --- PASS: TestExternalDNS (0.95s) === RUN TestExternalDNSIRSA I1013 02:48:32.031534 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:32.031611 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:32.031636 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:32.031673 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:32.031698 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:32.031729 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:32.031780 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:32.031797 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:32.031821 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:32.031838 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:32.055828 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:32.059083 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.059177 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.816967 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:32.976753 3037 executor.go:111] Tasks: 0 done / 112 total; 51 can run I1013 02:48:32.978455 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:32.978479 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:32.978563 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:32.985838 3037 executor.go:111] Tasks: 51 done / 112 total; 28 can run I1013 02:48:32.995653 3037 executor.go:111] Tasks: 79 done / 112 total; 25 can run I1013 02:48:32.996271 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.996590 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.996878 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.997460 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:32.997576 3037 executor.go:111] Tasks: 104 done / 112 total; 2 can run I1013 02:48:32.997940 3037 executor.go:111] Tasks: 106 done / 112 total; 6 can run I1013 02:48:32.998287 3037 executor.go:111] Tasks: 112 done / 112 total; 0 can run I1013 02:48:33.007234 3037 target.go:111] Terraform output is in /tmp/test4231179283/out --- PASS: TestExternalDNSIRSA (0.98s) === RUN TestKarpenter I1013 02:48:33.015019 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:33.015195 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:33.015249 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:33.015316 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:33.015387 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:33.015463 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:33.015584 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:33.015637 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:33.015696 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:33.015737 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:33.059150 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:48:33.064757 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:33.064851 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:33.064925 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:33.831659 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:34.010779 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.010913 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.011033 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1013 02:48:34.117535 3037 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W1013 02:48:34.117598 3037 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1013 02:48:34.117616 3037 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W1013 02:48:34.117631 3037 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1013 02:48:34.117646 3037 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I1013 02:48:34.138496 3037 executor.go:111] Tasks: 0 done / 122 total; 54 can run I1013 02:48:34.139700 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:34.139744 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:34.139839 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:34.141033 3037 executor.go:111] Tasks: 54 done / 122 total; 31 can run I1013 02:48:34.148226 3037 executor.go:111] Tasks: 85 done / 122 total; 29 can run I1013 02:48:34.148599 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.148770 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.148980 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.149132 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.149229 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.149524 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.149615 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.150079 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.150199 3037 executor.go:111] Tasks: 114 done / 122 total; 2 can run I1013 02:48:34.150603 3037 executor.go:111] Tasks: 116 done / 122 total; 6 can run I1013 02:48:34.150952 3037 executor.go:111] Tasks: 122 done / 122 total; 0 can run I1013 02:48:34.158153 3037 target.go:111] Terraform output is in /tmp/test2936451056/out --- PASS: TestKarpenter (1.15s) === RUN TestSharedSubnet I1013 02:48:34.164896 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:34.165027 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:34.165069 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:34.165115 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:34.165159 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:34.165209 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:34.165307 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:34.165341 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:34.165383 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:34.165412 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:34.193457 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:34.196682 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.196776 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:34.958202 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:35.091065 3037 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1013 02:48:35.091888 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:35.091910 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:35.091970 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:35.094585 3037 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1013 02:48:35.095022 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:35.100892 3037 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1013 02:48:35.101429 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:35.101705 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:35.102267 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:35.102366 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:35.102456 3037 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1013 02:48:35.102756 3037 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1013 02:48:35.103109 3037 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1013 02:48:35.108236 3037 target.go:111] Terraform output is in /tmp/test2728556489/out --- PASS: TestSharedSubnet (0.95s) === RUN TestSharedVPC I1013 02:48:35.112653 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:35.112798 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:35.112840 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:35.112887 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:35.112929 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:35.112981 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:35.113065 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:35.113096 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:35.113139 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:35.113170 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:35.132710 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:35.134502 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:35.134554 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:35.890309 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:36.054651 3037 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1013 02:48:36.054839 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:36.054862 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:36.054923 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:36.057622 3037 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1013 02:48:36.058041 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:36.063792 3037 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1013 02:48:36.064054 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:36.064210 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:36.065580 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:36.066063 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:36.066239 3037 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1013 02:48:36.066847 3037 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1013 02:48:36.067241 3037 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1013 02:48:36.072209 3037 target.go:111] Terraform output is in /tmp/test2210530914/out --- PASS: TestSharedVPC (0.96s) === RUN TestSharedVPCIPv6 I1013 02:48:36.074799 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:36.074875 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:36.074902 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:36.074955 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:36.074983 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:36.075014 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:36.075040 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:36.075057 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:36.075081 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:36.075098 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:36.076285 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:48:36.076318 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:36.091845 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:48:36.091876 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:36.091931 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:48:36.094222 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:36.094276 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.025587 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:37.184563 3037 executor.go:111] Tasks: 0 done / 133 total; 45 can run I1013 02:48:37.184770 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:37.184793 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:37.184871 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:37.192159 3037 executor.go:111] Tasks: 45 done / 133 total; 29 can run I1013 02:48:37.192899 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:37.193104 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:48:37.195672 3037 executor.go:111] Tasks: 74 done / 133 total; 37 can run I1013 02:48:37.196486 3037 executor.go:111] Tasks: 111 done / 133 total; 6 can run I1013 02:48:37.196670 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:48:37.196742 3037 loadbalancers.go:35] PageSize not implemented I1013 02:48:37.196856 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:48:37.196938 3037 loadbalancers.go:35] PageSize not implemented I1013 02:48:37.202429 3037 executor.go:111] Tasks: 117 done / 133 total; 8 can run I1013 02:48:37.202692 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.202927 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.203432 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.203524 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.203613 3037 executor.go:111] Tasks: 125 done / 133 total; 2 can run I1013 02:48:37.203977 3037 executor.go:111] Tasks: 127 done / 133 total; 6 can run I1013 02:48:37.204315 3037 executor.go:111] Tasks: 133 done / 133 total; 0 can run I1013 02:48:37.210835 3037 target.go:111] Terraform output is in /tmp/test1148043518/out --- PASS: TestSharedVPCIPv6 (1.14s) === RUN TestExistingIAM I1013 02:48:37.215404 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:37.215534 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:37.215575 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:37.215620 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:37.215662 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:37.215713 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:37.215795 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:37.215825 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:37.215866 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:37.215895 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:37.249355 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:37.252489 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.252558 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.252606 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:37.252655 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.005130 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:38.186970 3037 executor.go:111] Tasks: 0 done / 117 total; 51 can run I1013 02:48:38.191970 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:38.192002 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:38.192075 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:38.195096 3037 executor.go:111] Tasks: 51 done / 117 total; 19 can run I1013 02:48:38.201171 3037 executor.go:111] Tasks: 70 done / 117 total; 31 can run I1013 02:48:38.201445 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.201739 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.201952 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.202042 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.202188 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.202478 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.202609 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.202684 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.202777 3037 executor.go:111] Tasks: 101 done / 117 total; 4 can run I1013 02:48:38.203154 3037 executor.go:111] Tasks: 105 done / 117 total; 12 can run I1013 02:48:38.203520 3037 executor.go:111] Tasks: 117 done / 117 total; 0 can run I1013 02:48:38.207455 3037 target.go:111] Terraform output is in /tmp/test317815552/out --- PASS: TestExistingIAM (0.99s) === RUN TestPhaseNetwork I1013 02:48:38.210376 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:38.210467 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:38.210498 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:38.210543 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:38.210580 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:38.210630 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:38.210664 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:38.210694 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:38.210748 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:38.210778 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:38.237156 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:38.240736 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.240837 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.240898 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:38.999641 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:39.182227 3037 executor.go:111] Tasks: 0 done / 135 total; 47 can run I1013 02:48:39.182902 3037 executor.go:111] Tasks: 47 done / 135 total; 30 can run I1013 02:48:39.183439 3037 executor.go:111] Tasks: 77 done / 135 total; 36 can run I1013 02:48:39.183748 3037 executor.go:111] Tasks: 113 done / 135 total; 6 can run I1013 02:48:39.184007 3037 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1013 02:48:39.184177 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:48:39.184220 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:48:39.184278 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1013 02:48:39.184887 3037 target.go:111] Terraform output is in /tmp/test4222113440/out --- PASS: TestPhaseNetwork (0.97s) === RUN TestExternalLoadBalancer I1013 02:48:39.185224 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:39.185302 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:39.185328 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:39.185360 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:39.185385 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:39.185416 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:39.185473 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:39.185491 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:39.185514 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:39.185532 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:39.199714 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:39.201500 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:39.201556 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:39.976889 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:40.147155 3037 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1013 02:48:40.147840 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:40.147898 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:40.148025 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:40.151196 3037 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1013 02:48:40.157264 3037 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1013 02:48:40.157512 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.157819 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.159324 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.159805 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.160104 3037 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1013 02:48:40.160920 3037 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1013 02:48:40.161966 3037 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1013 02:48:40.167905 3037 target.go:111] Terraform output is in /tmp/test3764196449/out --- PASS: TestExternalLoadBalancer (0.99s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I1013 02:48:40.172407 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:40.172529 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:40.172569 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:40.172618 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:40.172660 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:40.172714 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:40.172793 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:40.172824 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:40.172864 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:40.172891 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:40.206704 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:40.210429 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.210525 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.210587 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.210646 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.210700 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.210765 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.210822 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:40.964821 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:41.137578 3037 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1013 02:48:41.139424 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:41.139443 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:41.139496 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:41.141340 3037 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1013 02:48:41.147356 3037 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1013 02:48:41.147661 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.147940 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148142 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148371 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148555 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148680 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148749 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148800 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.148872 3037 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1013 02:48:41.149211 3037 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1013 02:48:41.149573 3037 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1013 02:48:41.160476 3037 target.go:111] Terraform output is in /tmp/test1805443961/out --- PASS: TestMixedInstancesASG (0.99s) === RUN TestMixedInstancesSpotASG I1013 02:48:41.166391 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:41.166523 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:41.166564 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:41.166614 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:41.166655 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:41.166706 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:41.166797 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:41.166828 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:41.166866 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:41.166896 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:41.199693 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:41.203112 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.203198 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.203253 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.203306 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.203354 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.203398 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.203440 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:41.966226 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:42.162650 3037 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1013 02:48:42.163154 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:42.163197 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:42.163327 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:42.167909 3037 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1013 02:48:42.177552 3037 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1013 02:48:42.177980 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.178160 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.178347 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.178614 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.179937 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.180291 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.180462 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.180622 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.180890 3037 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1013 02:48:42.183220 3037 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1013 02:48:42.185288 3037 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1013 02:48:42.192592 3037 target.go:111] Terraform output is in /tmp/test140749749/out --- PASS: TestMixedInstancesSpotASG (1.03s) === RUN TestAdditionalObjects I1013 02:48:42.198215 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:42.198341 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:42.198385 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:42.198436 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:42.198476 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:42.198530 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:42.198615 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:42.198645 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:42.198682 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:42.198710 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:42.225046 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1013 02:48:42.226903 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.226957 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:42.982941 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:43.161588 3037 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1013 02:48:43.163891 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:43.163951 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:43.164127 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:43.165518 3037 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1013 02:48:43.171645 3037 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1013 02:48:43.172138 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:43.172378 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:43.172593 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:43.173103 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:43.173217 3037 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1013 02:48:43.173515 3037 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1013 02:48:43.173837 3037 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1013 02:48:43.179188 3037 target.go:111] Terraform output is in /tmp/test720760276/out --- PASS: TestAdditionalObjects (0.99s) === RUN TestContainerd I1013 02:48:43.183613 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:43.183738 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:43.183779 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:43.183823 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:43.183865 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:43.183917 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:43.184000 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:43.184031 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:43.184093 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:43.184120 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:43.209652 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:43.211506 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:43.211575 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:43.966973 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:44.095856 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:48:44.097871 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:44.098259 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:44.098364 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:44.099715 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:48:44.105407 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:48:44.105980 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.106241 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.106782 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.106876 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.106986 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:48:44.107391 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:48:44.107752 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:44.112870 3037 target.go:111] Terraform output is in /tmp/test2483717225/out --- PASS: TestContainerd (0.93s) === RUN TestContainerdCustom I1013 02:48:44.117279 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:44.117425 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:44.117469 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:44.117518 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:44.117569 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:44.117623 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:44.117705 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:44.117737 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:44.117777 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:44.117806 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:44.147157 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:44.150575 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.150668 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.642484 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:44.784657 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:48:44.787827 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:44.787863 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:44.787931 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:44.789951 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:48:44.795987 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:48:44.796452 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.798167 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.798661 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.799450 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.799787 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:48:44.800771 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:48:44.801892 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:44.805711 3037 target.go:111] Terraform output is in /tmp/test646080120/out --- PASS: TestContainerdCustom (0.69s) === RUN TestDockerCustom I1013 02:48:44.808281 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:44.808361 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:44.808387 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:44.808417 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:44.808442 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:44.808473 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:44.808526 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:44.808544 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:44.808567 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:44.808584 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:44.823776 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1013 02:48:44.825764 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:44.825815 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.318003 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:45.487826 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:48:45.488817 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:45.488862 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:45.488953 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:45.491233 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:48:45.494804 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:48:45.495153 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.495561 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.495861 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.496093 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.496347 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:48:45.496625 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:48:45.496871 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:45.502030 3037 target.go:111] Terraform output is in /tmp/test2517831006/out --- PASS: TestDockerCustom (0.70s) === RUN TestAPIServerNodes I1013 02:48:45.509236 3037 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1013 02:48:45.509268 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:45.509393 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:45.509438 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:45.509486 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:45.509529 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:45.509579 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:45.509665 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:45.509694 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:45.509734 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:45.509762 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:45.537069 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1013 02:48:45.540360 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.540447 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:45.540508 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.357060 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:46.541555 3037 executor.go:111] Tasks: 0 done / 114 total; 47 can run I1013 02:48:46.544067 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:46.544092 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:46.544150 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:46.545468 3037 executor.go:111] Tasks: 47 done / 114 total; 28 can run I1013 02:48:46.548364 3037 executor.go:111] Tasks: 75 done / 114 total; 27 can run I1013 02:48:46.548781 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.548907 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.549047 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.549165 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.549399 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.549490 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.549548 3037 executor.go:111] Tasks: 102 done / 114 total; 3 can run I1013 02:48:46.549895 3037 executor.go:111] Tasks: 105 done / 114 total; 9 can run I1013 02:48:46.550258 3037 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1013 02:48:46.556898 3037 target.go:111] Terraform output is in /tmp/test628572932/out I1013 02:48:46.559250 3037 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.05s) === RUN TestNTHIMDSProcessor I1013 02:48:46.559329 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:46.559394 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:46.559426 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:46.559452 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:46.559485 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:46.559511 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:46.559552 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:46.559566 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:46.559585 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:46.559599 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:46.570312 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:46.571761 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:46.571800 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:47.326901 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:47.493739 3037 executor.go:111] Tasks: 0 done / 90 total; 44 can run I1013 02:48:47.494061 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:47.494091 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:47.494191 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:47.497281 3037 executor.go:111] Tasks: 44 done / 90 total; 19 can run I1013 02:48:47.503317 3037 executor.go:111] Tasks: 63 done / 90 total; 21 can run I1013 02:48:47.503758 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:47.504000 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:47.504318 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:47.504742 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:47.504844 3037 executor.go:111] Tasks: 84 done / 90 total; 2 can run I1013 02:48:47.505169 3037 executor.go:111] Tasks: 86 done / 90 total; 4 can run I1013 02:48:47.505426 3037 executor.go:111] Tasks: 90 done / 90 total; 0 can run I1013 02:48:47.510050 3037 target.go:111] Terraform output is in /tmp/test887080883/out --- PASS: TestNTHIMDSProcessor (0.95s) === RUN TestNTHIMDSProcessorIRSA I1013 02:48:47.514107 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:47.514237 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:47.514278 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:47.514323 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:47.514362 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:47.514417 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:47.514499 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:47.514530 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:47.514571 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:47.514600 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:47.535816 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:47.537690 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:47.537744 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:48.291441 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:48.468848 3037 executor.go:111] Tasks: 0 done / 101 total; 50 can run I1013 02:48:48.469586 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:48.469611 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:48.469670 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:48.472640 3037 executor.go:111] Tasks: 50 done / 101 total; 24 can run I1013 02:48:48.481256 3037 executor.go:111] Tasks: 74 done / 101 total; 21 can run I1013 02:48:48.482480 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:48.482770 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:48.483338 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:48.483442 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:48.483546 3037 executor.go:111] Tasks: 95 done / 101 total; 2 can run I1013 02:48:48.483906 3037 executor.go:111] Tasks: 97 done / 101 total; 4 can run I1013 02:48:48.484237 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:48.490422 3037 target.go:111] Terraform output is in /tmp/test4063107451/out --- PASS: TestNTHIMDSProcessorIRSA (0.98s) === RUN TestCustomIRSA I1013 02:48:48.495430 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:48.495556 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:48.495597 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:48.495647 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:48.495690 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:48.495741 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:48.495823 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:48.495853 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:48.495891 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:48.495919 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:48.524653 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:48.527977 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:48.528055 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:49.281113 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:49.874839 3037 executor.go:111] Tasks: 0 done / 114 total; 52 can run I1013 02:48:49.875412 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:49.875433 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:49.875491 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:49.882801 3037 executor.go:111] Tasks: 52 done / 114 total; 29 can run I1013 02:48:49.889642 3037 executor.go:111] Tasks: 81 done / 114 total; 25 can run I1013 02:48:49.889777 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:49.890041 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:49.890307 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:49.890691 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:49.890822 3037 executor.go:111] Tasks: 106 done / 114 total; 2 can run I1013 02:48:49.891113 3037 executor.go:111] Tasks: 108 done / 114 total; 6 can run I1013 02:48:49.891389 3037 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1013 02:48:49.897850 3037 target.go:111] Terraform output is in /tmp/test3969754898/out --- PASS: TestCustomIRSA (1.41s) === RUN TestClusterNameDigit I1013 02:48:49.906230 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:49.906359 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:49.906401 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:49.906450 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:49.906493 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:49.906544 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:49.906631 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:49.906664 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:49.906706 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:49.906735 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:49.937769 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:48:49.941609 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:49.941703 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.705866 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:50.880953 3037 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1013 02:48:50.881451 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:50.881508 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:50.881572 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:50.884127 3037 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1013 02:48:50.890223 3037 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1013 02:48:50.890449 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.890575 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.891883 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.892782 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.892996 3037 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1013 02:48:50.894301 3037 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1013 02:48:50.895305 3037 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1013 02:48:50.900197 3037 target.go:111] Terraform output is in /tmp/test2271449593/out --- PASS: TestClusterNameDigit (1.00s) === RUN TestCASPriorityExpander I1013 02:48:50.904072 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:50.904181 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:50.904236 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:50.904304 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:50.904371 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:50.904439 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:50.904571 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:50.904605 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:50.904640 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:50.904666 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:50.932069 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:48:50.935310 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.935381 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.935430 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:50.935477 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1013 02:48:52.378340 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:52.590638 3037 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1013 02:48:52.594125 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:52.594172 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:52.594289 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:52.597399 3037 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1013 02:48:52.603912 3037 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1013 02:48:52.604220 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.604453 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.604702 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.604918 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.605130 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.605250 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.605403 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.605695 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.605814 3037 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1013 02:48:52.606243 3037 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1013 02:48:52.606651 3037 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1013 02:48:52.613086 3037 target.go:111] Terraform output is in /tmp/test2478407732/out --- PASS: TestCASPriorityExpander (1.71s) === RUN TestCASPriorityExpanderCustom I1013 02:48:52.618317 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:52.618450 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:52.618492 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:52.618537 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:52.618590 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:52.618647 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:52.618732 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:52.618766 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:52.618806 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:52.618837 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:48:52.649560 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1013 02:48:52.651736 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.651789 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.651823 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:52.651855 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1013 02:48:53.409108 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:53.577761 3037 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1013 02:48:53.581026 3037 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1013 02:48:53.581054 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:53.581132 3037 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1013 02:48:53.584016 3037 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1013 02:48:53.590068 3037 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1013 02:48:53.590293 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.590472 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.590570 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.590826 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.590998 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.591093 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.591288 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.591604 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.591718 3037 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1013 02:48:53.592093 3037 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1013 02:48:53.592484 3037 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1013 02:48:53.599350 3037 target.go:111] Terraform output is in /tmp/test4156873058/out --- PASS: TestCASPriorityExpanderCustom (0.99s) === RUN TestLifecycleMinimalAWS I1013 02:48:53.604713 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:48:53.604857 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:48:53.604900 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:48:53.604949 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:48:53.604997 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:48:53.605050 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:48:53.605096 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:48:53.605127 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:48:53.605167 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:48:53.605195 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1013 02:48:53.634513 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1013 02:48:53.637605 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:53.637700 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1013 02:48:54.444851 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:54.636623 3037 iamrole.go:89] ListRoles: { } I1013 02:48:54.638193 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:48:54.638559 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1013 02:48:54.638731 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1013 02:48:54.638828 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:54.638824 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:48:54.638938 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1013 02:48:54.639063 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.639065 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1013 02:48:54.639167 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I1013 02:48:54.639113 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.639361 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1013 02:48:54.639583 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.639704 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:48:54.639765 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:54.640061 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:48:54.640266 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:48:54.640322 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I1013 02:48:54.640492 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:48:54.640627 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:48:54.640673 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:48:54.640765 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:48:54.640801 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:48:54.640848 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:48:54.641899 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:48:54.642087 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1013 02:48:54.642131 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:54.643311 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:48:54.643163 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:48:54.643412 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:48:54.643638 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:48:54.643685 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:48:54.643843 3037 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1013 02:48:54.643821 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1013 02:48:54.643895 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:54.643968 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:48:54.644110 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:48:54.644171 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1013 02:48:54.644237 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I1013 02:48:54.644583 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:48:54.644725 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1013 02:48:54.645008 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:48:54.645127 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:54.645393 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:48:54.645616 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:48:54.645998 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:48:54.646593 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:48:54.646639 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:48:54.646707 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:48:54.646740 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.646791 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:48:54.646831 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:48:54.646888 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:48:54.646919 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1013 02:48:54.646788 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:48:54.649575 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:48:54.649727 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.649896 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1013 02:48:54.650021 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:54.650182 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:54.650345 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.650538 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.650791 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.651015 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.651158 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:54.651231 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.651357 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.651525 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:54.651636 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:54.651713 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:54.651811 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.651964 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:48:54.652025 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.652156 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.652276 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:54.652417 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" }] }] } I1013 02:48:54.652546 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.652668 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:48:54.652719 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:48:54.652829 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:48:54.652872 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1013 02:48:54.653203 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:48:54.653494 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:48:54.653722 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:54.653762 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:54.653785 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:48:54.653831 3037 dns.go:235] Pre-creating DNS records I1013 02:48:54.653850 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:48:54.657204 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1013 02:48:54.658922 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:54.658976 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1013 02:48:55.471970 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:55.656080 3037 iamrole.go:89] ListRoles: { } I1013 02:48:55.657579 3037 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1013 02:48:55.657827 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:48:55.657955 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I1013 02:48:55.658276 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.658394 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:48:55.658428 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:48:55.658478 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:48:55.658590 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.659091 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.659263 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:48:55.660526 3037 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1013 02:48:55.660748 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1013 02:48:55.660776 3037 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1013 02:48:55.660781 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.660911 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1013 02:48:55.661062 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:48:55.661113 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.661233 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:48:55.661268 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.661377 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:48:55.661453 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:48:55.661526 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1013 02:48:55.661643 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:48:55.663972 3037 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1013 02:48:55.664133 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:55.664258 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:55.664460 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:55.664552 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:55.664761 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:55.664941 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:55.665109 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:48:55.665718 3037 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1013 02:48:55.665929 3037 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1013 02:48:55.666078 3037 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1013 02:48:55.668609 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:48:55.668673 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:48:55.668715 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:48:55.668749 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:48:55.668782 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:48:55.668815 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:48:55.668848 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:48:55.668886 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:48:55.668923 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:48:55.668965 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:48:55.669004 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:48:55.669037 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:48:55.669069 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:48:55.669104 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:48:55.669135 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:48:55.669170 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:48:55.669203 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:48:55.669240 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:48:55.669271 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:48:55.669304 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:48:55.669335 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:48:55.669373 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:48:55.669409 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:48:55.669443 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:48:55.670652 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:48:55.670763 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:48:55.670786 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:48:55.670829 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.670882 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1013 02:48:55.670963 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671024 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671070 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671125 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671168 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671210 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1013 02:48:55.671257 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671308 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:48:55.671350 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1013 02:48:55.671395 3037 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1013 02:48:55.671431 3037 api.go:53] PageSize not implemented I1013 02:48:55.671453 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:48:55.671480 3037 loadbalancers.go:35] PageSize not implemented I1013 02:48:55.671498 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:48:55.671528 3037 targetgroups.go:35] PageSize not implemented I1013 02:48:55.671546 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:48:55.671605 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:48:55.671644 3037 iamrole.go:89] ListRoles: { } I1013 02:48:55.671698 3037 zones.go:93] ListHostedZonesPages { } I1013 02:48:55.671727 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:48:55.671769 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:48:55.671814 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:48:55.671850 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:48:55.672388 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1013 02:48:55.672459 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:48:55.672507 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:nodes.minimal.example.com ok I1013 02:48:55.672511 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:48:55.672561 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1013 02:48:55.672439 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:48:55.672587 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I1013 02:48:55.672621 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1013 02:48:55.672584 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1013 02:48:55.672760 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:48:55.672788 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1013 02:48:55.672872 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1013 02:48:55.672923 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1013 02:48:55.672964 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1013 02:48:55.672987 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:48:55.673016 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1013 02:48:55.673138 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:48:55.673147 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:48:55.673196 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:48:55.673234 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1013 02:48:55.673264 3037 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1013 02:48:55.673275 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:48:55.673297 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1013 02:48:55.673318 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1013 02:48:55.673342 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1013 02:48:55.673349 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:48:55.673365 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1013 02:48:55.673400 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:48:55.673446 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:48:55.673492 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (2.07s) === RUN TestLifecycleMinimalOpenstack I1013 02:48:55.673807 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I1013 02:48:55.681361 3037 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:48:56.582448 3037 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1013 02:48:56.582491 3037 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1013 02:48:56.600117 3037 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/10/13 02:48:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:48:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1013 02:48:56.604106 3037 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1013 02:48:56.613018 3037 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1013 02:48:56.615396 3037 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/10/13 02:48:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:48:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:48:56 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1013 02:48:56.617334 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1013 02:48:56.617733 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1013 02:48:57.622106 3037 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:48:58.480802 3037 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1013 02:48:58.480855 3037 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1013 02:48:58.498740 3037 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/10/13 02:48:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:48:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1013 02:48:58.507325 3037 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1013 02:48:58.511563 3037 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1013 02:48:58.512457 3037 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/10/13 02:48:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:48:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:48:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1013 02:48:58.513972 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1013 02:48:58.514641 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1013 02:48:58.514745 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1013 02:48:58.515109 3037 executor.go:111] Tasks: 92 done / 92 total; 0 can run I1013 02:48:58.516673 3037 delete_cluster.go:128] Looking for cloud resources to delete 2023/10/13 02:48:58 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Subnet:16e8e9b6-7c45-4c98-a7d4-0aea973b157d ok SecurityGroup:c3bb9e6d-1fe9-4548-b080-948c4fffc69d ok ServerGroup:bd43b8ac-884f-4817-9cff-d01cba61829d ok Port:21a26e6b-dcbe-461a-9b25-6838aaf5f1c0 ok SecurityGroup:50560902-0138-4f9a-88bd-f313852be79f ok Instance:3c3cf8f4-b9f0-4af5-8174-236b724a7566 ok Port:2e4efa37-186d-4238-bdb7-029a1124f71d ok Instance:42588bf4-2f52-43c2-b33b-822890d2ac28 ok Port:f3047393-ee96-435d-bb51-e6cf394fe482 ok Network:3670c4bd-9fab-4acb-b63e-0c86dff9ea44 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok SecurityGroup:62135ab5-4df8-4667-b25a-2439558e9dd3 ok ServerGroup:bb18dc1b-80d0-417d-bcd2-8e92a126d58e ok Instance:219ee07a-1b7c-40db-9c4f-4f9a4726a9f5 ok --- PASS: TestLifecycleMinimalOpenstack (3.94s) === RUN TestLifecycleMinimalGCE I1013 02:48:59.615276 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I1013 02:48:59.617030 3037 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:49:00.787492 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:49:00.787591 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:49:00.787723 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1013 02:49:00.787760 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1013 02:49:00.787786 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1013 02:49:00.787857 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:49:00.789303 3037 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1013 02:49:00.793351 3037 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1013 02:49:00.799225 3037 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1013 02:49:00.800017 3037 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1013 02:49:00.800229 3037 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1013 02:49:00.800310 3037 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:49:01.934467 3037 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1013 02:49:01.934539 3037 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1013 02:49:01.934618 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1013 02:49:01.934638 3037 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1013 02:49:01.934652 3037 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1013 02:49:01.934693 3037 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1013 02:49:01.935594 3037 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1013 02:49:01.938953 3037 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1013 02:49:01.944839 3037 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1013 02:49:01.945939 3037 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1013 02:49:01.946164 3037 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1013 02:49:01.947872 3037 delete_cluster.go:128] Looking for cloud resources to delete I1013 02:49:01.947933 3037 gce.go:99] Scanning zones: [us-test1-a] I1013 02:49:01.948314 3037 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I1013 02:49:01.948340 3037 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:master-to-node-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1697165340 ok InstanceTemplate:nodes-minimal-gce-example-com-1697165340 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (2.33s) === RUN TestLifecycleFloatingIPOpenstack I1013 02:49:01.949586 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I1013 02:49:01.960295 3037 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:49:02.854321 3037 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1013 02:49:02.854378 3037 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1013 02:49:02.871233 3037 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/10/13 02:49:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:49:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1013 02:49:02.878898 3037 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1013 02:49:02.883752 3037 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1013 02:49:02.885807 3037 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/10/13 02:49:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:49:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:49:02 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1013 02:49:02.887458 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1013 02:49:02.887484 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1013 02:49:03.894544 3037 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1013 02:49:04.974566 3037 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1013 02:49:04.974614 3037 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1013 02:49:04.995135 3037 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/10/13 02:49:04 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:49:05 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1013 02:49:05.003870 3037 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1013 02:49:05.007692 3037 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1013 02:49:05.008990 3037 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/10/13 02:49:05 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:49:05 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/10/13 02:49:05 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1013 02:49:05.010450 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1013 02:49:05.011924 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1013 02:49:05.012094 3037 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1013 02:49:05.012465 3037 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1013 02:49:05.014110 3037 delete_cluster.go:128] Looking for cloud resources to delete 2023/10/13 02:49:05 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router-IF:1283612e-2b9d-4cb1-a337-96007357422c ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:0257d12a-49e3-4260-91ab-6025fd464918 ok Instance:55de1896-57fe-4b3c-9335-f63de3aff15d ok Subnet:1283612e-2b9d-4cb1-a337-96007357422c ok Network:8f614608-602d-4181-bec1-c099705e9a3a ok Port:ccebf766-92e7-40d4-a66c-5d4edd6118c2 ok ServerGroup:5ea43269-c437-4f7b-90e4-46598571f164 ok SecurityGroup:ddf32a3c-7b1b-48ff-9f5d-8d9511a0cf39 ok SecurityGroup:92832d0f-fc34-4cfd-b749-4835f0bbc354 ok Instance:bdce6f0b-b794-449b-9ebd-066b169ed294 ok ServerGroup:6c700824-c23b-4de5-852f-eb9311b1aeca ok SecurityGroup:d78f8a6a-f56e-4fbe-a0e2-735706b8a649 ok Port:3fb97d25-ef45-4bca-8dc6-3aec2dd3d48e ok Router:15edebde-112f-45b3-8c0b-332359000639 ok Port:14db32f9-2968-45e3-91ac-35f0ef06a58f ok Port:757afe2c-5d0f-4fa5-9f25-1b2ae9ec1ec6 ok --- PASS: TestLifecycleFloatingIPOpenstack (4.17s) === RUN TestLifecyclePrivateCalico I1013 02:49:06.119927 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:06.120150 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:06.120217 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:06.121760 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:06.121892 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:06.122034 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:06.122188 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:06.122828 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:06.122891 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:06.122932 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I1013 02:49:06.154148 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:49:06.157770 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:06.157858 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:06.157925 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.199119 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:07.602864 3037 iamrole.go:89] ListRoles: { } I1013 02:49:07.605149 3037 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1013 02:49:07.605422 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:07.605643 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.605810 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.605865 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.605979 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:49:07.606018 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:49:07.606055 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:07.606100 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:07.606052 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I1013 02:49:07.606159 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatecalico.example.com" }] } I1013 02:49:07.606154 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:07.606309 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:07.606361 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.606508 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.606603 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:07.606721 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I1013 02:49:07.606801 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1013 02:49:07.606995 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I1013 02:49:07.607062 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:07.607060 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1013 02:49:07.607172 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.607268 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] }] } I1013 02:49:07.607382 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:07.607463 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:07.609153 3037 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1013 02:49:07.609337 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:07.609424 3037 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1013 02:49:07.609518 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1013 02:49:07.609492 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.609569 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1013 02:49:07.609597 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1013 02:49:07.609676 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1013 02:49:07.609707 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1013 02:49:07.609838 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1013 02:49:07.609968 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1013 02:49:07.609911 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1013 02:49:07.610049 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1013 02:49:07.610083 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1013 02:49:07.609993 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1013 02:49:07.610137 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:07.610239 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:07.610204 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1013 02:49:07.610216 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1013 02:49:07.610293 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:07.610369 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1013 02:49:07.610642 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] }] } I1013 02:49:07.610881 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1013 02:49:07.610887 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.611193 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:49:07.611267 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:07.611193 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:07.611388 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:07.611464 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:07.611519 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:49:07.611603 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.611768 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1013 02:49:07.611858 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:07.611949 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:07.612015 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:07.612175 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" }] }], VpcId: "vpc-1" } I1013 02:49:07.612326 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:07.612493 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:07.612593 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:07.612662 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" } ] } I1013 02:49:07.612729 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1013 02:49:07.612799 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.612929 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:07.613001 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:07.613094 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:07.613165 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:07.613282 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:07.613346 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:07.613424 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:07.613494 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:07.613147 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1013 02:49:07.613566 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:07.613643 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:07.613716 3037 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I1013 02:49:07.613908 3037 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1013 02:49:07.614150 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1013 02:49:07.614500 3037 api.go:53] PageSize not implemented I1013 02:49:07.614382 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" }] }] } I1013 02:49:07.614651 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1013 02:49:07.614660 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:07.614769 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:07.614686 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:07.614820 3037 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } I1013 02:49:07.614902 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:07.614936 3037 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1013 02:49:07.614869 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.614956 3037 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I1013 02:49:07.615113 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:07.615000 3037 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1013 02:49:07.615202 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I1013 02:49:07.615247 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1013 02:49:07.615343 3037 api.go:53] PageSize not implemented I1013 02:49:07.615372 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:07.615431 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1013 02:49:07.615499 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.615690 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.615842 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:07.615969 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1013 02:49:07.616088 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.616295 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:07.616427 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:07.616591 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:07.616691 3037 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1013 02:49:07.616719 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1013 02:49:07.616921 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.617070 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:07.617167 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.617319 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1013 02:49:07.617439 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.617591 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.617717 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I1013 02:49:07.617842 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I1013 02:49:07.617964 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1013 02:49:07.618088 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.618221 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I1013 02:49:07.618348 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1013 02:49:07.618490 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.618627 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:07.618672 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1013 02:49:07.618802 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.618928 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1013 02:49:07.619034 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.619177 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.619276 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1013 02:49:07.619405 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I1013 02:49:07.619538 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.619663 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.619797 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1013 02:49:07.619837 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1013 02:49:07.619874 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.619987 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1013 02:49:07.620071 3037 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1013 02:49:07.620130 3037 api.go:53] PageSize not implemented I1013 02:49:07.620167 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:07.620229 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1013 02:49:07.620333 3037 api.go:53] PageSize not implemented I1013 02:49:07.620360 3037 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:07.620237 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:07.620390 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:07.620535 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:07.620539 3037 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1013 02:49:07.620720 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1013 02:49:07.620796 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:07.620757 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:07.620849 3037 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1013 02:49:07.620896 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:07.625770 3037 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1013 02:49:07.626018 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:07.626188 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I1013 02:49:07.626253 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.626369 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.626550 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.626681 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.627442 3037 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1013 02:49:07.627734 3037 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1013 02:49:07.628050 3037 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1013 02:49:07.628099 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:07.628135 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:07.628217 3037 dns.go:235] Pre-creating DNS records I1013 02:49:07.628255 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:07.634916 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:49:07.638632 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.638724 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:07.638799 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:08.639335 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:08.999038 3037 iamrole.go:89] ListRoles: { } I1013 02:49:09.000372 3037 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1013 02:49:09.000737 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.000877 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:09.000898 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:09.000930 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:09.001271 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:09.002265 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:09.003009 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.003560 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.004816 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.005868 3037 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1013 02:49:09.006038 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.006247 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:09.006364 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1013 02:49:09.006567 3037 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1013 02:49:09.006649 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.006890 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:09.007062 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1013 02:49:09.006976 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.007267 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1013 02:49:09.007300 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1013 02:49:09.007466 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:09.007820 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1013 02:49:09.007509 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1013 02:49:09.007923 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:09.007916 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1013 02:49:09.007968 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:09.007958 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1013 02:49:09.007998 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1013 02:49:09.008082 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:09.008107 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.008232 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.008362 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:09.008401 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:09.009363 3037 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1013 02:49:09.009677 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.009826 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1013 02:49:09.009898 3037 api.go:53] PageSize not implemented I1013 02:49:09.009933 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.010036 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.010080 3037 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I1013 02:49:09.009954 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:09.010126 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:09.010139 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1013 02:49:09.010070 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:09.010179 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1013 02:49:09.010206 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1013 02:49:09.010239 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1013 02:49:09.010275 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1013 02:49:09.010282 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1013 02:49:09.010355 3037 api.go:53] PageSize not implemented I1013 02:49:09.010371 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.010413 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:09.010618 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:09.010723 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:09.010778 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:09.010808 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1013 02:49:09.010836 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1013 02:49:09.010904 3037 executor.go:111] Tasks: 120 done / 142 total; 6 can run I1013 02:49:09.010952 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:09.011000 3037 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" W1013 02:49:09.011012 3037 api.go:53] PageSize not implemented I1013 02:49:09.011008 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:09.011055 3037 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1013 02:49:09.011043 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.011045 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:09.011157 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:09.011199 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W1013 02:49:09.011243 3037 api.go:53] PageSize not implemented I1013 02:49:09.011267 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.011359 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.014416 3037 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1013 02:49:09.014494 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.014576 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:09.014644 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.014719 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.014789 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.015585 3037 executor.go:111] Tasks: 134 done / 142 total; 2 can run W1013 02:49:09.015718 3037 api.go:53] PageSize not implemented I1013 02:49:09.015735 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.015858 3037 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1013 02:49:09.016048 3037 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1013 02:49:09.019554 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:09.019635 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:09.019698 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:09.019747 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1013 02:49:09.019792 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:09.019840 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:09.019890 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:09.019930 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:09.019980 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:09.020033 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:09.020081 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:09.020137 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1013 02:49:09.020199 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1013 02:49:09.020243 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:09.020289 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:09.020330 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:09.020379 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:09.020417 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:09.020466 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:09.020507 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:09.020559 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:09.020608 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:09.020665 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:09.020741 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:09.020788 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:09.020849 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:09.020890 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:09.020933 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:09.020980 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:09.021028 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:09.021070 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:09.022743 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:09.022827 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:09.022851 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:09.022904 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.022982 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1013 02:49:09.023069 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023155 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023221 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023299 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023363 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023424 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1013 02:49:09.023515 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023583 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:09.023626 3037 natgateway.go:117] DescribeNatGateways: { } I1013 02:49:09.023671 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1013 02:49:09.023725 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W1013 02:49:09.023785 3037 api.go:53] PageSize not implemented I1013 02:49:09.023813 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1013 02:49:09.023868 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:09.023901 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:09.023923 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1013 02:49:09.023967 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:09.024003 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:09.024028 3037 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I1013 02:49:09.024130 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:09.024178 3037 iamrole.go:89] ListRoles: { } I1013 02:49:09.024239 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:09.024272 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:09.024340 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:09.024396 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:09.024458 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I1013 02:49:09.024502 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:09.024559 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-group:nodes.privatecalico.example.com ok I1013 02:49:09.025267 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok autoscaling-group:bastion.privatecalico.example.com ok I1013 02:49:09.025367 3037 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I1013 02:49:09.025355 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1013 02:49:09.025431 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I1013 02:49:09.025468 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1013 02:49:09.025430 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I1013 02:49:09.025515 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I1013 02:49:09.025542 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1013 02:49:09.025343 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } I1013 02:49:09.025491 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } W1013 02:49:09.025654 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatecalico.example.com ok I1013 02:49:09.025617 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I1013 02:49:09.025639 3037 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I1013 02:49:09.025676 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:09.025735 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:09.025774 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W1013 02:49:09.025851 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-3 ok I1013 02:49:09.025892 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1013 02:49:09.025962 3037 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1013 02:49:09.026014 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:09.026048 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } W1013 02:49:09.026150 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:09.026160 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1013 02:49:09.026193 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1013 02:49:09.026231 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:09.026258 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1013 02:49:09.026276 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1013 02:49:09.026307 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1013 02:49:09.026377 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I1013 02:49:09.026414 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I1013 02:49:09.026425 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1013 02:49:09.026448 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I1013 02:49:09.026431 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1013 02:49:09.026472 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I1013 02:49:09.026553 3037 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I1013 02:49:09.026529 3037 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1013 02:49:09.026578 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1013 02:49:09.026592 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:09.026629 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I1013 02:49:09.026682 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I1013 02:49:09.026736 3037 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I1013 02:49:09.026749 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1013 02:49:09.026644 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 } ] } I1013 02:49:09.026779 3037 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } W1013 02:49:09.026790 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:bastions.privatecalico.example.com ok I1013 02:49:09.026811 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1013 02:49:09.026854 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:49:09.026949 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:09.027005 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1013 02:49:09.027080 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:49:09.027153 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (2.91s) === RUN TestLifecyclePrivateKopeio I1013 02:49:09.027689 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:09.027829 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:09.027866 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:09.027906 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:09.027945 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:09.027994 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:09.028035 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:09.028065 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:09.028102 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:09.028132 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I1013 02:49:09.057405 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:09.061033 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.061119 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.061178 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:09.806558 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:10.002755 3037 iamrole.go:89] ListRoles: { } I1013 02:49:10.004986 3037 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1013 02:49:10.005344 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:10.005518 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.005734 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.005851 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:10.005903 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:10.006090 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.006144 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I1013 02:49:10.006233 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1013 02:49:10.006256 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.006441 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:10.006570 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:10.006600 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I1013 02:49:10.006623 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.006694 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1013 02:49:10.006829 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.006876 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I1013 02:49:10.006971 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I1013 02:49:10.006988 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.007080 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:10.007265 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:10.007336 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:49:10.007391 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:49:10.007419 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:10.007462 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:10.008286 3037 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1013 02:49:10.008430 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1013 02:49:10.008513 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1013 02:49:10.008547 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:10.008613 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1013 02:49:10.008654 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:10.008728 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1013 02:49:10.008768 3037 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1013 02:49:10.008702 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1013 02:49:10.008816 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1013 02:49:10.008759 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1013 02:49:10.008862 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1013 02:49:10.008957 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1013 02:49:10.008973 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.009088 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1013 02:49:10.009164 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1013 02:49:10.009193 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.009267 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1013 02:49:10.009320 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1013 02:49:10.009379 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1013 02:49:10.009393 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1013 02:49:10.009445 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1013 02:49:10.009550 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:10.009595 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:10.009677 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.009762 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1013 02:49:10.009840 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:10.009908 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.009977 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.010053 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.010128 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.010115 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:10.010198 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:49:10.010281 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.010298 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:10.010408 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:49:10.010446 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:10.010274 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1013 02:49:10.010495 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1013 02:49:10.010556 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1013 02:49:10.010651 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:10.010731 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:10.010779 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:10.010920 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:10.010912 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1013 02:49:10.010998 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:10.011046 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:10.011095 3037 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1013 02:49:10.011170 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1013 02:49:10.011235 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.011342 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:10.011320 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1013 02:49:10.011417 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:10.011478 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:10.011520 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1013 02:49:10.011558 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:10.011603 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1013 02:49:10.011638 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1013 02:49:10.011679 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:10.011736 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:10.011778 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:10.011806 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:10.011878 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:10.011911 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:10.011950 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1013 02:49:10.012019 3037 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] } I1013 02:49:10.012091 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:10.012202 3037 executor.go:111] Tasks: 81 done / 144 total; 41 can run W1013 02:49:10.012501 3037 api.go:53] PageSize not implemented I1013 02:49:10.012415 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.012582 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:10.012555 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } W1013 02:49:10.012650 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:10.012637 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.012666 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.012727 3037 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1013 02:49:10.012768 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.012794 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.012830 3037 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1013 02:49:10.012782 3037 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I1013 02:49:10.012879 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1013 02:49:10.012918 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I1013 02:49:10.012885 3037 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1013 02:49:10.013008 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.013175 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" }] }] } I1013 02:49:10.013289 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I1013 02:49:10.013425 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" }] }] } I1013 02:49:10.013590 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.013707 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:10.013763 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.013814 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.013877 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1013 02:49:10.013934 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.014083 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.014145 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" }] }] } I1013 02:49:10.014249 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1013 02:49:10.014311 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.014422 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:10.014452 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:10.014507 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.014615 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.014730 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1013 02:49:10.014767 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-2" } I1013 02:49:10.014794 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:10.014820 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1013 02:49:10.014846 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.014946 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1013 02:49:10.014990 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.015092 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.015191 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.015285 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:10.015327 3037 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1013 02:49:10.015360 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1013 02:49:10.015391 3037 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1013 02:49:10.015421 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1013 02:49:10.015517 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.015617 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1013 02:49:10.015646 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.015742 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1013 02:49:10.015843 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1013 02:49:10.015920 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:10.015993 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1013 02:49:10.016094 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:10.016171 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.016246 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1013 02:49:10.016327 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:10.016363 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1013 02:49:10.016390 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1013 02:49:10.016424 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:10.016462 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1013 02:49:10.016426 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } I1013 02:49:10.016497 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1013 02:49:10.016548 3037 api.go:53] PageSize not implemented I1013 02:49:10.016570 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.016581 3037 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1013 02:49:10.016618 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:10.016653 3037 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1013 02:49:10.016681 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1013 02:49:10.016718 3037 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1013 02:49:10.016751 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I1013 02:49:10.016808 3037 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1013 02:49:10.016887 3037 api.go:53] PageSize not implemented I1013 02:49:10.016874 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:10.016917 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:10.016947 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.016941 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:10.017065 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-1" } I1013 02:49:10.017123 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:10.017247 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I1013 02:49:10.017194 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W1013 02:49:10.017160 3037 api.go:53] PageSize not implemented I1013 02:49:10.017320 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:10.017379 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.026233 3037 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1013 02:49:10.026577 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.026694 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.026945 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.027093 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.027846 3037 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1013 02:49:10.028099 3037 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1013 02:49:10.028421 3037 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1013 02:49:10.028475 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:10.028509 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:10.028580 3037 dns.go:235] Pre-creating DNS records I1013 02:49:10.028605 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:10.035476 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:10.039017 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.039102 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.039163 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.796740 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:10.944150 3037 iamrole.go:89] ListRoles: { } I1013 02:49:10.945252 3037 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1013 02:49:10.945735 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.945928 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.946164 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:10.946372 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.947817 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:10.948673 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.948796 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:10.948829 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:10.948886 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:10.952038 3037 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1013 02:49:10.952145 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.952210 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1013 02:49:10.952258 3037 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1013 02:49:10.952243 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] }] } I1013 02:49:10.952381 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:10.952424 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:10.952470 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1013 02:49:10.952534 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.952649 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.952728 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.952855 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1013 02:49:10.952988 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:10.953032 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.953070 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1013 02:49:10.953117 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1013 02:49:10.953137 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:10.953138 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1013 02:49:10.953168 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1013 02:49:10.953271 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:10.953305 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.953402 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:10.953461 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.953554 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1013 02:49:10.953579 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:10.953635 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1013 02:49:10.953744 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:10.953778 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1013 02:49:10.953882 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:10.954372 3037 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1013 02:49:10.954471 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1013 02:49:10.954612 3037 api.go:53] PageSize not implemented I1013 02:49:10.954534 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1013 02:49:10.954609 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:10.954694 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:10.954725 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1013 02:49:10.954768 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1013 02:49:10.954800 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1013 02:49:10.954693 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.954768 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.954826 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1013 02:49:10.954936 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:10.954897 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.955007 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1013 02:49:10.955121 3037 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } W1013 02:49:10.955219 3037 api.go:53] PageSize not implemented I1013 02:49:10.955191 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:10.955243 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.955369 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.955485 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.955751 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.955895 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1013 02:49:10.956127 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:10.956374 3037 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1013 02:49:10.956440 3037 api.go:53] PageSize not implemented I1013 02:49:10.956481 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.956480 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:10.956570 3037 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1013 02:49:10.956594 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W1013 02:49:10.956644 3037 api.go:53] PageSize not implemented I1013 02:49:10.956589 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:10.956700 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.956591 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:10.956818 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:10.956870 3037 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1013 02:49:10.956892 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.962215 3037 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1013 02:49:10.962410 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.962522 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.962702 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.962828 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.963505 3037 executor.go:111] Tasks: 136 done / 144 total; 2 can run W1013 02:49:10.963601 3037 api.go:53] PageSize not implemented I1013 02:49:10.963622 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.963817 3037 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1013 02:49:10.964061 3037 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1013 02:49:10.967506 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:10.967584 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:10.967629 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:10.967665 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:10.967707 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:10.967741 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:10.967783 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:10.967820 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:10.967864 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:10.967905 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:10.967951 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1013 02:49:10.967990 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:10.968026 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:10.968061 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:10.968099 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:10.968132 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:10.968176 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1013 02:49:10.968213 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:10.968256 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:10.968291 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:10.968326 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:10.968370 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:10.968408 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:10.968447 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:10.968486 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1013 02:49:10.968521 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1013 02:49:10.968560 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:10.968593 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:10.968627 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:10.968666 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:10.968703 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:10.968737 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:10.970386 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:10.970456 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:10.970477 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:10.970518 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.970580 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1013 02:49:10.970647 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.970741 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.970803 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.970856 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.970898 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.970952 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1013 02:49:10.971033 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.971098 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:10.971131 3037 natgateway.go:117] DescribeNatGateways: { } I1013 02:49:10.971167 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1013 02:49:10.971212 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W1013 02:49:10.971266 3037 api.go:53] PageSize not implemented I1013 02:49:10.971283 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1013 02:49:10.971324 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:10.971350 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:10.971368 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1013 02:49:10.971406 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:10.971429 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:10.971447 3037 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I1013 02:49:10.971508 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:10.971550 3037 iamrole.go:89] ListRoles: { } I1013 02:49:10.971603 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:10.971632 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:10.971673 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:10.971723 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:10.971779 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I1013 02:49:10.971826 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1013 02:49:10.971858 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1013 02:49:10.972523 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:10.972579 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I1013 02:49:10.972643 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1013 02:49:10.972726 3037 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } autoscaling-group:bastion.privatekopeio.example.com ok I1013 02:49:10.972717 3037 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I1013 02:49:10.972729 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1013 02:49:10.972600 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } I1013 02:49:10.972788 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok W1013 02:49:10.972801 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:10.972813 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I1013 02:49:10.972819 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } autoscaling-group:nodes.privatekopeio.example.com ok security-group:sg-4 ok I1013 02:49:10.972838 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1013 02:49:10.972863 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I1013 02:49:10.972850 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } load-balancer:api-privatekopeio-example-tl2bv8 ok I1013 02:49:10.972808 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatekopeio.example.com. ok I1013 02:49:10.972927 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I1013 02:49:10.972978 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1013 02:49:10.973049 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:10.973109 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W1013 02:49:10.973232 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:10.973251 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1013 02:49:10.973284 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:10.973706 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1013 02:49:10.973911 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-1 ok I1013 02:49:10.973957 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-config:lt-3 ok volume:vol-1 ok I1013 02:49:10.974003 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I1013 02:49:10.974071 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } volume:vol-2 ok security-group:sg-2 ok I1013 02:49:10.974196 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1013 02:49:10.974210 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I1013 02:49:10.974303 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1013 02:49:10.974260 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:49:10.974322 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1013 02:49:10.974359 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I1013 02:49:10.974372 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1013 02:49:10.974392 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I1013 02:49:10.974445 3037 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I1013 02:49:10.974439 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1013 02:49:10.974462 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1013 02:49:10.974480 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:10.974500 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I1013 02:49:10.974505 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1013 02:49:10.974560 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:10.974568 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:10.974542 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I1013 02:49:10.974602 3037 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1013 02:49:10.974618 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1013 02:49:10.974657 3037 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I1013 02:49:10.974746 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:10.974853 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1013 02:49:10.974951 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1013 02:49:10.975017 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:49:10.975057 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (1.95s) === RUN TestLifecycleIPv6 I1013 02:49:10.975318 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:10.975395 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:10.975418 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:10.975438 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:10.975456 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:10.975480 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:10.975499 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:10.975513 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:10.975538 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:10.975552 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I1013 02:49:10.988650 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:49:10.990298 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:10.990338 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:11.737552 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:11.847579 3037 iamrole.go:89] ListRoles: { } I1013 02:49:11.849668 3037 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1013 02:49:11.849928 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.850047 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:11.850142 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I1013 02:49:11.850276 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:11.850332 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.850544 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I1013 02:49:11.850470 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:11.851933 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:49:11.851975 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:49:11.852020 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:11.852061 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:11.852049 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I1013 02:49:11.852147 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1013 02:49:11.852236 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.854016 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.854237 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:11.854323 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I1013 02:49:11.854496 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:11.854507 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1013 02:49:11.854735 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.855121 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:11.855695 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:11.857003 3037 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1013 02:49:11.857188 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1013 02:49:11.857118 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1013 02:49:11.857248 3037 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1013 02:49:11.857262 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.857331 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1013 02:49:11.857400 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.857448 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1013 02:49:11.857522 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:11.857686 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:49:11.857660 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1013 02:49:11.857656 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1013 02:49:11.857739 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.857787 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1013 02:49:11.857834 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:11.857912 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.857945 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1013 02:49:11.857952 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1013 02:49:11.858035 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:11.858092 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I1013 02:49:11.858167 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.858270 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1013 02:49:11.858376 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1013 02:49:11.858357 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1013 02:49:11.858568 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1013 02:49:11.858752 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I1013 02:49:11.858845 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.858957 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:11.859072 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:11.859189 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:11.859245 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:11.859358 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:11.859417 3037 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I1013 02:49:11.859538 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:11.859744 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:11.859853 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:11.859711 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1013 02:49:11.859926 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:11.860000 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:11.860025 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1013 02:49:11.860103 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1013 02:49:11.860148 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:11.860216 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:11.860264 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:49:11.860324 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1013 02:49:11.860372 3037 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I1013 02:49:11.860499 3037 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1013 02:49:11.860621 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.860748 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.860851 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.860909 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1013 02:49:11.860996 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:11.861033 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:11.860999 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:11.861071 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:11.861100 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:11.861123 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" }] }] } I1013 02:49:11.861263 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.861388 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I1013 02:49:11.861470 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.861568 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:11.861618 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.861878 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I1013 02:49:11.861868 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:11.861970 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.862027 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:11.862091 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:11.862129 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.862167 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.862209 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:11.862269 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:11.862157 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:11.862272 3037 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.862315 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.862414 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.862362 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:11.862493 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:11.862548 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1013 02:49:11.862576 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:11.862608 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1013 02:49:11.862648 3037 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.862649 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.862902 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.863079 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I1013 02:49:11.863239 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:49:11.863323 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I1013 02:49:11.863394 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I1013 02:49:11.863552 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.863713 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.863876 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.864068 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" }] }] } I1013 02:49:11.864260 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1013 02:49:11.864340 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1013 02:49:11.864511 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.864667 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:49:11.864743 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:11.864900 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1013 02:49:11.864971 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1013 02:49:11.865026 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1013 02:49:11.865146 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I1013 02:49:11.865299 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1013 02:49:11.865343 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I1013 02:49:11.865434 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1013 02:49:11.865513 3037 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1013 02:49:11.865609 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:11.865662 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:11.865672 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W1013 02:49:11.865752 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:11.865856 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1013 02:49:11.865910 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I1013 02:49:11.865950 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:11.865957 3037 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-2" },{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I1013 02:49:11.866066 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:11.866107 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:11.866160 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I1013 02:49:11.866226 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:11.866250 3037 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1013 02:49:11.866306 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } W1013 02:49:11.866323 3037 api.go:53] PageSize not implemented I1013 02:49:11.866356 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:11.866448 3037 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:11.866526 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.866585 3037 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.866673 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I1013 02:49:11.866727 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-5" } I1013 02:49:11.866780 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1013 02:49:11.866827 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:11.866868 3037 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1013 02:49:11.866912 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:11.866981 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.867052 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I1013 02:49:11.867087 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.867150 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1013 02:49:11.867188 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1013 02:49:11.867223 3037 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:11.867358 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I1013 02:49:11.867344 3037 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1013 02:49:11.867448 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1013 02:49:11.867499 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I1013 02:49:11.867551 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1013 02:49:11.867603 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:11.867645 3037 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I1013 02:49:11.867714 3037 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1013 02:49:11.867822 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:11.867881 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:11.867828 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:11.867903 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:11.868034 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:11.868092 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:11.867815 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.868114 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:11.867999 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:11.868194 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I1013 02:49:11.868228 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:11.868251 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:11.868331 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:11.868374 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I1013 02:49:11.868428 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:11.868554 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I1013 02:49:11.868610 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:11.868724 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I1013 02:49:11.873811 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:11.873997 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:11.874136 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:11.874199 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:11.874280 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:11.874864 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:11.875104 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:11.875354 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:49:11.875408 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:11.875445 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:11.875510 3037 dns.go:235] Pre-creating DNS records I1013 02:49:11.875534 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:11.882198 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1013 02:49:11.885859 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:11.885946 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:13.103221 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:13.243075 3037 iamrole.go:89] ListRoles: { } I1013 02:49:13.244247 3037 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1013 02:49:13.244460 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.244692 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.244962 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.245072 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:13.245507 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:13.246062 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.246274 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:13.246340 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:13.246431 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:13.248089 3037 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1013 02:49:13.248416 3037 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1013 02:49:13.248291 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1013 02:49:13.248475 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1013 02:49:13.248465 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1013 02:49:13.248497 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.248627 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1013 02:49:13.248739 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1013 02:49:13.248736 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1013 02:49:13.248918 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:13.248986 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.249208 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.249421 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.249632 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:13.249714 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1013 02:49:13.249973 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:13.250067 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:13.250158 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:13.250210 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.250463 3037 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1013 02:49:13.250585 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.250633 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:13.250660 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1013 02:49:13.250683 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1013 02:49:13.250734 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.250774 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1013 02:49:13.250792 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1013 02:49:13.250809 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1013 02:49:13.250838 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.250961 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1013 02:49:13.251035 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.251211 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.251384 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.251530 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:13.251580 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.251776 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:13.251837 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] }] } I1013 02:49:13.251962 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:13.252054 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] }] } I1013 02:49:13.252182 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:13.252271 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.252417 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1013 02:49:13.252460 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1013 02:49:13.252551 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:13.252675 3037 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1013 02:49:13.252790 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.252822 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:13.252908 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:13.252933 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.252987 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.252877 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:13.253023 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1013 02:49:13.253063 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1013 02:49:13.253098 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1013 02:49:13.253092 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1013 02:49:13.253194 3037 api.go:53] PageSize not implemented I1013 02:49:13.253210 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.253298 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.253378 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.253452 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.253532 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1013 02:49:13.253630 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.253750 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:13.253869 3037 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1013 02:49:13.253960 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:13.254059 3037 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1013 02:49:13.254103 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:13.254123 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.254065 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:13.254135 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.254175 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:13.254207 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:13.254181 3037 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1013 02:49:13.254212 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.254217 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.254320 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:13.254375 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:13.254319 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:13.254394 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.254448 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1013 02:49:13.254477 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:13.254510 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.259844 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:13.259993 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:13.260190 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:13.260282 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:13.260475 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:13.261255 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:13.261501 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:13.261716 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:49:13.265112 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:13.265180 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:13.265226 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:13.265264 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I1013 02:49:13.265303 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1013 02:49:13.265341 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:13.265375 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1013 02:49:13.265411 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:13.265445 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:13.265481 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:13.265518 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:13.265555 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:13.265598 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:13.265638 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1013 02:49:13.265673 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1013 02:49:13.265714 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:13.265749 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:13.265782 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:13.265823 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:13.265857 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:13.265894 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1013 02:49:13.265931 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:13.265966 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:13.266001 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:13.266036 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:13.266074 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:13.266110 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:13.266149 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1013 02:49:13.266186 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1013 02:49:13.266223 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1013 02:49:13.266260 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1013 02:49:13.266298 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:13.266332 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:13.266365 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:13.266404 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:13.266443 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:13.266480 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:13.270360 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:13.270515 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:13.270549 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:13.270644 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.270902 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1013 02:49:13.271301 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271357 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271408 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271455 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271503 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271546 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1013 02:49:13.271602 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271666 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:13.271695 3037 natgateway.go:117] DescribeNatGateways: { } I1013 02:49:13.271734 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1013 02:49:13.271768 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W1013 02:49:13.271817 3037 api.go:53] PageSize not implemented I1013 02:49:13.271833 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:13.271854 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:13.271867 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1013 02:49:13.271902 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:13.271924 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:13.272561 3037 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I1013 02:49:13.272634 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:13.272670 3037 iamrole.go:89] ListRoles: { } I1013 02:49:13.272706 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:13.272731 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:13.272769 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:13.272805 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:13.272850 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1","rtb-3"] } I1013 02:49:13.272889 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1013 02:49:13.272922 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1013 02:49:13.272953 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:13.272981 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1013 02:49:13.273602 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:13.273671 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } autoscaling-group:nodes.minimal-ipv6.example.com ok I1013 02:49:13.273722 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1013 02:49:13.273655 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1013 02:49:13.273777 3037 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I1013 02:49:13.273730 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1013 02:49:13.273806 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok iam-instance-profile:nodes.minimal-ipv6.example.com ok I1013 02:49:13.273835 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } I1013 02:49:13.273731 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } subnet:subnet-1 ok I1013 02:49:13.273876 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } subnet:subnet-5 ok I1013 02:49:13.273905 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok route53-record:Z1AFAKE1ZON3YO/A/api.minimal-ipv6.example.com ok I1013 02:49:13.273948 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I1013 02:49:13.273883 3037 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I1013 02:49:13.273922 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 } ] } W1013 02:49:13.274104 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:13.274121 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1013 02:49:13.274149 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:13.274180 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:13.274202 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1013 02:49:13.274241 3037 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-2 ok I1013 02:49:13.274282 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:13.274313 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1013 02:49:13.274388 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:13.274397 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:13.274417 3037 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I1013 02:49:13.274446 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1013 02:49:13.274482 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1013 02:49:13.274515 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1013 02:49:13.274577 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:13.274612 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1013 02:49:13.274640 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1013 02:49:13.274638 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I1013 02:49:13.274686 3037 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I1013 02:49:13.274735 3037 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1013 02:49:13.274783 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I1013 02:49:13.274836 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1013 02:49:13.274843 3037 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1013 02:49:13.274886 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I1013 02:49:13.274942 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1013 02:49:13.274958 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1013 02:49:13.274997 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I1013 02:49:13.275030 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I1013 02:49:13.275113 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1013 02:49:13.275172 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1013 02:49:13.275249 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:49:13.275326 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (2.30s) === RUN TestLifecycleSharedVPC I1013 02:49:13.275840 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:13.276063 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:13.276129 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:13.276199 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:13.276272 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:13.276361 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:13.276447 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:13.276508 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:13.276579 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:13.276633 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I1013 02:49:13.301715 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:13.304871 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:13.304958 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:14.320075 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:14.454230 3037 iamrole.go:89] ListRoles: { } I1013 02:49:14.456318 3037 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1013 02:49:14.456693 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] }] } I1013 02:49:14.457001 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:14.457224 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:14.457338 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:14.457346 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1013 02:49:14.457457 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:14.457485 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:14.457470 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1013 02:49:14.457766 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:14.457935 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.459009 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:14.459130 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:14.459605 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:14.459914 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:14.460104 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I1013 02:49:14.460162 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] } I1013 02:49:14.461794 3037 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1013 02:49:14.462018 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1013 02:49:14.461970 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:14.462046 3037 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1013 02:49:14.462078 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1013 02:49:14.462128 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I1013 02:49:14.462067 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1013 02:49:14.462239 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1013 02:49:14.462303 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:14.462389 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:14.462435 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:14.462469 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:14.462506 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1013 02:49:14.462544 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:14.462634 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I1013 02:49:14.462645 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1013 02:49:14.462935 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:14.463068 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:14.463111 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:14.463141 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:14.463176 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" } ] } I1013 02:49:14.463235 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:14.463293 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:14.463322 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:14.464869 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1013 02:49:14.467511 3037 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1013 02:49:14.467733 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.467908 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.468135 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.468353 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.468577 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1013 02:49:14.468797 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.468948 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:14.469030 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:14.469110 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1013 02:49:14.469242 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:14.469323 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" }] }] } I1013 02:49:14.469470 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.469604 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1013 02:49:14.469653 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1013 02:49:14.469788 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" }] }] } I1013 02:49:14.469912 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.470041 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1013 02:49:14.470086 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:14.470181 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:14.470311 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1013 02:49:14.470509 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:14.470562 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1013 02:49:14.470606 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I1013 02:49:14.470781 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:14.470872 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:14.471592 3037 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1013 02:49:14.471913 3037 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1013 02:49:14.472213 3037 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1013 02:49:14.472275 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:14.472311 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:14.472377 3037 dns.go:235] Pre-creating DNS records I1013 02:49:14.472407 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:14.475852 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:14.477221 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:14.477262 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:15.236284 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:15.387727 3037 iamrole.go:89] ListRoles: { } I1013 02:49:15.388478 3037 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1013 02:49:15.389428 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.390329 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:15.390379 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:15.390398 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:15.390618 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:15.390724 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:15.391295 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.393704 3037 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1013 02:49:15.394061 3037 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1013 02:49:15.394121 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1013 02:49:15.393984 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I1013 02:49:15.394242 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:15.394303 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1013 02:49:15.394461 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:15.394531 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1013 02:49:15.394689 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:15.394741 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:15.394887 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.396932 3037 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1013 02:49:15.397109 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:15.397308 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:15.397496 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:15.397654 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:15.397917 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:15.398069 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:15.398283 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:15.398805 3037 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1013 02:49:15.399010 3037 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1013 02:49:15.399241 3037 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1013 02:49:15.404027 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:15.404080 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:15.404097 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:15.404111 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:15.404126 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:15.404141 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:15.404159 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:15.404179 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:15.404199 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:15.404215 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:15.404230 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:15.404249 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:15.404266 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:15.404281 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:15.404297 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:15.404314 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:15.404327 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:15.404342 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:15.404357 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:15.404374 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:15.404391 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:15.405111 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:15.405150 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:15.405160 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:15.405179 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405204 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1013 02:49:15.405231 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405261 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405283 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405303 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405326 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405345 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1013 02:49:15.405369 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405400 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1013 02:49:15.405416 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W1013 02:49:15.405444 3037 api.go:53] PageSize not implemented I1013 02:49:15.405457 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:15.405469 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:15.405479 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:15.405490 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:15.405500 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:15.405528 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:15.405546 3037 iamrole.go:89] ListRoles: { } I1013 02:49:15.405569 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:15.405584 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:15.405603 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:15.405624 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:15.405637 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:15.405831 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.sharedvpc.example.com ok I1013 02:49:15.405859 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1013 02:49:15.405919 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I1013 02:49:15.405960 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1013 02:49:15.405964 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } autoscaling-config:lt-2 ok I1013 02:49:15.406083 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:15.406048 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedvpc.example.com. ok I1013 02:49:15.406105 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I1013 02:49:15.406122 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I1013 02:49:15.406184 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:15.406174 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1013 02:49:15.406325 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I1013 02:49:15.406245 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1013 02:49:15.406459 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:15.406481 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:15.406527 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:15.406632 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:49:15.406624 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I1013 02:49:15.406676 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1013 02:49:15.406692 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1013 02:49:15.406728 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I1013 02:49:15.406759 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I1013 02:49:15.406801 3037 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I1013 02:49:15.406814 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1013 02:49:15.406841 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I1013 02:49:15.406900 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.13s) === RUN TestLifecycleComplex I1013 02:49:15.407469 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:15.407605 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:15.407642 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:15.407682 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:15.407721 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:15.407770 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:15.407809 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:15.407840 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:15.407878 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:15.407906 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I1013 02:49:15.443528 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:15.447448 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:15.447534 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:16.437025 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:16.629473 3037 iamrole.go:89] ListRoles: { } I1013 02:49:16.631354 3037 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1013 02:49:16.631670 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I1013 02:49:16.631824 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I1013 02:49:16.632020 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.632267 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:16.632431 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:16.632497 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I1013 02:49:16.632497 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W1013 02:49:16.632613 3037 api.go:53] PageSize not implemented I1013 02:49:16.632595 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1013 02:49:16.632895 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:16.632680 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.634505 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1013 02:49:16.634715 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:16.634799 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.635085 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:16.635321 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:16.635474 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.635808 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:16.635804 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1013 02:49:16.635993 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:16.636285 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:16.636401 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:49:16.636448 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:49:16.636488 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:16.636539 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:16.636733 3037 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1013 02:49:16.637274 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.637455 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1013 02:49:16.637512 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1013 02:49:16.637566 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.637628 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1013 02:49:16.637425 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:16.637782 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:16.637732 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:16.637830 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:16.637861 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1013 02:49:16.637855 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:16.637941 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1013 02:49:16.637899 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1013 02:49:16.637994 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1013 02:49:16.638660 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:16.638720 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:16.638761 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:16.638805 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.638835 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1013 02:49:16.639052 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:16.639123 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:16.639073 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1013 02:49:16.639119 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:16.639210 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1013 02:49:16.639367 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:16.639607 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1013 02:49:16.639728 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1013 02:49:16.639820 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1013 02:49:16.639916 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:16.640005 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.640090 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:16.640170 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:16.640172 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:16.640244 3037 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I1013 02:49:16.640305 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1013 02:49:16.640408 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:16.640463 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:16.640508 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:16.640591 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:16.640640 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:16.640731 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:16.640789 3037 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I1013 02:49:16.640824 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:16.640783 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:16.640858 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I1013 02:49:16.640920 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:16.640947 3037 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" } ] } I1013 02:49:16.641008 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:16.641038 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:16.641063 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:49:16.641094 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:49:16.641123 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:16.641152 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:16.641203 3037 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1013 02:49:16.641364 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I1013 02:49:16.641441 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" } ] }] } I1013 02:49:16.641572 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1013 02:49:16.641905 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1013 02:49:16.642149 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1013 02:49:16.642375 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1013 02:49:16.642526 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1013 02:49:16.642688 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:16.642781 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:16.642962 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1013 02:49:16.642912 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1013 02:49:16.643085 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:16.643223 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1013 02:49:16.643294 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:16.643387 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:16.643466 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:16.643540 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1013 02:49:16.643711 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1013 02:49:16.643864 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1013 02:49:16.643914 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1013 02:49:16.644007 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I1013 02:49:16.644188 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1013 02:49:16.644338 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1013 02:49:16.644485 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:16.644617 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1013 02:49:16.644680 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1013 02:49:16.644839 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I1013 02:49:16.644937 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1013 02:49:16.644981 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1013 02:49:16.645067 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I1013 02:49:16.645208 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I1013 02:49:16.645292 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I1013 02:49:16.645339 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1013 02:49:16.645425 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I1013 02:49:16.645511 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I1013 02:49:16.645554 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1013 02:49:16.645638 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I1013 02:49:16.645726 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1013 02:49:16.645813 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1013 02:49:16.645956 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1013 02:49:16.646097 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:16.646140 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1013 02:49:16.646284 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1013 02:49:16.646332 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1013 02:49:16.646383 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:16.646455 3037 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1013 02:49:16.646517 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:16.646562 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:16.646649 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:16.646646 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1013 02:49:16.646686 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I1013 02:49:16.646761 3037 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api.complex.example.com" } ], Type: "network" } I1013 02:49:16.646879 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:16.646935 3037 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1013 02:49:16.647031 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1013 02:49:16.647100 3037 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:16.647173 3037 api.go:53] PageSize not implemented I1013 02:49:16.647221 3037 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1013 02:49:16.647304 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:16.647289 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1013 02:49:16.647360 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:16.647415 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:16.647475 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:16.647568 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:16.647649 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:16.647610 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:16.647671 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:16.647745 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:16.653745 3037 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1013 02:49:16.654007 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:16.654162 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:16.654255 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:16.654377 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:16.655107 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:49:16.655364 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:49:16.655703 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1013 02:49:16.655756 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:16.655791 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:16.655856 3037 dns.go:235] Pre-creating DNS records I1013 02:49:16.655881 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:16.663989 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:16.668165 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:16.668258 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:17.428431 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:17.595262 3037 iamrole.go:89] ListRoles: { } I1013 02:49:17.596574 3037 executor.go:111] Tasks: 0 done / 135 total; 51 can run W1013 02:49:17.596957 3037 api.go:53] PageSize not implemented I1013 02:49:17.596966 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.597144 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.597444 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.597623 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:17.597692 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.597859 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:17.597916 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:17.598016 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:17.598114 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:17.598303 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:17.598812 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:17.599139 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:17.600385 3037 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1013 02:49:17.600549 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:17.600542 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:17.600661 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:17.600656 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.600786 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:17.600906 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:17.600910 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:17.600946 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:17.600995 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:17.601094 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:17.601025 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1013 02:49:17.601138 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:17.601239 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:17.601363 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.601518 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:17.601675 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:17.601718 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.601872 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:17.601915 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.602042 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:17.602129 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:17.602213 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:17.602404 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:17.602449 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:17.602636 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:17.602801 3037 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1013 02:49:17.602953 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:17.603066 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:17.603289 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:17.603420 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:17.603613 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:17.603835 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:17.603997 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.604198 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:17.604430 3037 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1013 02:49:17.604518 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:17.604553 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:17.604662 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:17.604693 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:17.604768 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:17.604829 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:17.604891 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:17.604949 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:17.605005 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:17.605127 3037 api.go:53] PageSize not implemented I1013 02:49:17.605196 3037 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1013 02:49:17.605292 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:17.605350 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:17.605415 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1013 02:49:17.605431 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:17.605456 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:17.605511 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:17.605456 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:17.605632 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:17.605612 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:17.605680 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:17.605706 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:17.605803 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:17.606044 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:17.606095 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:17.614365 3037 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1013 02:49:17.614530 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:17.614642 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:17.614815 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:17.614915 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:17.615710 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:49:17.615945 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:49:17.616147 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I1013 02:49:17.619758 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:17.621753 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:17.629138 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:17.631496 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:17.631565 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:18.380287 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:18.547028 3037 iamrole.go:89] ListRoles: { } I1013 02:49:18.548362 3037 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1013 02:49:18.548583 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.548673 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:18.548694 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:18.548734 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:18.548824 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:18.548898 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.548972 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:18.549056 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:18.549148 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W1013 02:49:18.549472 3037 api.go:53] PageSize not implemented I1013 02:49:18.549392 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.549604 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.549730 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:18.550890 3037 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1013 02:49:18.551131 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:18.551284 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:18.551251 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.551344 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:18.551370 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:18.551321 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:18.551414 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:18.551431 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:18.551448 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:18.551466 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:18.551477 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.551572 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:18.551609 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:18.551701 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:18.551876 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:18.551966 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.552155 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:18.552261 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1013 02:49:18.552396 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:18.552487 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:18.552642 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:18.552684 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.552789 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:18.552923 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:18.553003 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:18.553095 3037 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1013 02:49:18.553218 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:18.553357 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:18.553447 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:18.553770 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:18.554022 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:18.554242 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:18.554379 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:18.554523 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:18.554683 3037 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1013 02:49:18.554767 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:18.554811 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:18.554864 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:18.554875 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.554901 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.554923 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:18.554947 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:18.554966 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:18.554984 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:18.555095 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I1013 02:49:18.555116 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:18.555136 3037 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I1013 02:49:18.555155 3037 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I1013 02:49:18.555175 3037 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1013 02:49:18.555234 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1013 02:49:18.555272 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.555292 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W1013 02:49:18.555313 3037 api.go:53] PageSize not implemented I1013 02:49:18.555353 3037 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1013 02:49:18.555383 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:18.555408 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:18.555417 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.555435 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:18.555524 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:18.555493 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:18.555572 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:18.555562 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:18.555625 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:18.555597 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.555692 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:18.555722 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.555788 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:18.555818 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:18.558745 3037 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1013 02:49:18.558860 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:18.558951 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:18.559081 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:18.559244 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:18.559798 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:49:18.560011 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:49:18.560260 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1013 02:49:18.560316 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:18.560353 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:18.560420 3037 dns.go:235] Pre-creating DNS records I1013 02:49:18.568209 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:18.572355 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:18.572448 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:19.320370 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:19.515300 3037 iamrole.go:89] ListRoles: { } I1013 02:49:19.517456 3037 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1013 02:49:19.517791 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W1013 02:49:19.518032 3037 api.go:53] PageSize not implemented I1013 02:49:19.518021 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.518193 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:19.518302 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:19.518340 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:19.518390 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:19.518387 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:19.518423 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.518671 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.518809 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.518940 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:19.519125 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:19.520304 3037 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1013 02:49:19.520452 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:19.520495 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:19.520527 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:19.520535 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:19.520666 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:19.520762 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:19.520735 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:19.520824 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:19.520889 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:19.520868 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:19.520920 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:19.520961 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.521112 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:19.521274 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:19.521360 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:19.521447 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:19.521531 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.521662 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:19.521809 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:19.521855 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I1013 02:49:19.521983 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.522124 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:19.522164 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.522256 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:19.522385 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:19.522491 3037 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1013 02:49:19.522625 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.522750 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:19.522913 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:19.522964 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:19.523022 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:19.523068 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:19.523119 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:19.523336 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:19.523431 3037 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1013 02:49:19.523477 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:19.523533 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:19.523628 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:19.523648 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:19.523696 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:19.523734 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:19.523774 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:19.523809 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:19.523841 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:19.523935 3037 api.go:53] PageSize not implemented I1013 02:49:19.523995 3037 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1013 02:49:19.524056 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:19.524115 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:19.524071 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:19.524133 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:19.524195 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:19.524213 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:19.524230 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:19.524266 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:19.524304 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:19.524324 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:19.524403 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:19.524431 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:19.524537 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:19.524565 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:19.529808 3037 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1013 02:49:19.529931 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:19.530083 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:19.530228 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:19.530336 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:19.530864 3037 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1013 02:49:19.531085 3037 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1013 02:49:19.531255 3037 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I1013 02:49:19.534613 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:19.538090 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:19.550292 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:19.554350 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:19.554441 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.302499 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:20.489003 3037 iamrole.go:89] ListRoles: { } I1013 02:49:20.490895 3037 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1013 02:49:20.491222 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.491474 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:20.491707 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.491908 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:20.491977 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1013 02:49:20.492223 3037 api.go:53] PageSize not implemented I1013 02:49:20.492164 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.492406 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:20.492420 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:20.492556 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:20.492659 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:20.492756 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:20.492827 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:20.492868 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1013 02:49:20.494210 3037 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1013 02:49:20.494402 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:20.494570 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:20.494638 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:20.494730 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:20.494730 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:20.494794 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:20.494837 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:20.494825 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:20.494882 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:20.494939 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:20.494962 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:20.495027 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:20.495058 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:20.495016 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.495165 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:20.495259 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.495387 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.495535 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:20.495576 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:20.495732 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:20.495788 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:20.496014 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:20.496097 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.496286 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.496435 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:20.496524 3037 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1013 02:49:20.496761 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:20.496852 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:20.497002 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:20.497236 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:20.497585 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:20.497776 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:20.498162 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:20.498286 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:20.498435 3037 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1013 02:49:20.498531 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:20.498570 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:20.498659 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:20.498679 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:20.498728 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:20.498765 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:20.498805 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:20.498840 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:20.498873 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:20.498969 3037 api.go:53] PageSize not implemented I1013 02:49:20.499030 3037 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1013 02:49:20.499109 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:20.499129 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:20.499214 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:20.499213 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:20.499195 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:20.499283 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:20.499240 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:20.499465 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:20.499522 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:20.499602 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:20.499658 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:20.499743 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:20.499801 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:20.499817 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:20.507696 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:20.507782 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.507883 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.508047 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.508228 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.509047 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.509114 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.509267 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:20.509531 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:20.509803 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:49:20.509856 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:20.509891 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:20.509969 3037 dns.go:235] Pre-creating DNS records I1013 02:49:20.518466 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:20.522996 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:20.523090 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.276823 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:21.465414 3037 iamrole.go:89] ListRoles: { } I1013 02:49:21.466714 3037 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1013 02:49:21.467139 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W1013 02:49:21.467297 3037 api.go:53] PageSize not implemented I1013 02:49:21.467405 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.467585 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.467721 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:21.467745 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.467888 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:21.467926 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:21.467974 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1013 02:49:21.468097 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:21.468152 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:21.468255 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:21.468502 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.469231 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:21.470458 3037 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1013 02:49:21.470670 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:21.470833 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:21.470746 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:21.470898 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:21.470914 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:21.470942 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:21.470996 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:21.471031 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:21.470993 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.471098 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:21.471126 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:21.471186 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:21.471237 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:21.471306 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.471399 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:21.471423 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:21.471530 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:21.471569 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:21.471620 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.471704 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:21.471752 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.471816 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:21.471862 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.471936 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:21.472025 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:21.472422 3037 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1013 02:49:21.472584 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:21.472783 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:21.472960 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:21.473159 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:21.473294 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:21.473886 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:21.473985 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:21.474116 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:21.474318 3037 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1013 02:49:21.474401 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:21.474409 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1013 02:49:21.474470 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:21.474491 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:21.474536 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:21.474574 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:21.474615 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:21.474654 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:21.474686 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:21.474777 3037 api.go:53] PageSize not implemented I1013 02:49:21.474822 3037 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1013 02:49:21.474869 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:21.474917 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:21.474908 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:21.474932 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:21.474992 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:21.475020 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:21.475048 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:21.475016 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:21.475113 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:21.475106 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:21.475159 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:21.475183 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:21.475277 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:21.475314 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:21.480887 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:21.481076 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.481240 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.481356 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.481527 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.482101 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:21.482348 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:21.482644 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I1013 02:49:21.487557 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:21.491007 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.491098 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.500860 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:21.504986 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.505077 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:21.505131 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.252817 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:22.460928 3037 iamrole.go:89] ListRoles: { } I1013 02:49:22.462789 3037 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1013 02:49:22.463175 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1013 02:49:22.463330 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.463465 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:22.463514 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:22.463469 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:22.463587 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:22.463643 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1013 02:49:22.463775 3037 api.go:53] PageSize not implemented I1013 02:49:22.463797 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:22.463904 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:22.464011 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.464113 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:22.464189 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.464285 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:22.465592 3037 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1013 02:49:22.465728 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.465885 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:22.465853 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:22.465893 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:22.465991 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:22.465999 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:22.466041 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:22.466166 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:22.466163 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.466230 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:22.466288 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:22.466318 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:22.466292 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.466410 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:22.466545 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:22.466591 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:22.466670 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:22.466713 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:22.466846 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:22.466917 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:22.466992 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.467111 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:22.467145 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:22.467251 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:22.467321 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.467458 3037 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1013 02:49:22.467686 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:22.467771 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:22.467911 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:22.468102 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:22.468199 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:22.468393 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:22.468503 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:22.468693 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:22.468878 3037 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1013 02:49:22.468943 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:22.468987 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:22.469062 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:22.469082 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:22.469120 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:22.469152 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:22.469186 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:22.469218 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:22.469247 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:22.469330 3037 api.go:53] PageSize not implemented I1013 02:49:22.469372 3037 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1013 02:49:22.469411 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:22.469452 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:22.469465 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:22.469478 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:22.469599 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:22.469630 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:22.469634 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:22.469715 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:22.469697 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:22.469733 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:22.469947 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:22.469981 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:22.470031 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:22.470052 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:22.478267 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:22.478467 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.478658 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.478802 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.479010 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.479663 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:22.480041 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:22.480280 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:49:22.480330 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:22.480372 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:22.480456 3037 dns.go:235] Pre-creating DNS records I1013 02:49:22.489104 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:22.493700 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.493798 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:22.493879 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.243088 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:23.440679 3037 iamrole.go:89] ListRoles: { } I1013 02:49:23.442850 3037 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1013 02:49:23.443093 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:23.443261 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1013 02:49:23.443364 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:23.443451 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:23.443515 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.443710 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1013 02:49:23.443894 3037 api.go:53] PageSize not implemented I1013 02:49:23.443834 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1013 02:49:23.443957 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:23.443942 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:23.443994 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:23.444131 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:23.444190 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:23.444393 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.446318 3037 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1013 02:49:23.446460 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:23.446479 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.446646 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:23.446665 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.446747 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:23.446782 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:23.446787 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:23.446777 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.446945 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:23.446906 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:23.447004 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:23.446994 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:23.447060 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:23.447088 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:23.447239 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:23.447292 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:23.447463 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.447649 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:23.447856 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:23.447918 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:23.448018 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:23.448091 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:23.448259 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.448488 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:23.448565 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:23.448695 3037 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1013 02:49:23.448936 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:23.449136 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:23.449245 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:23.449272 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:23.449328 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:23.449411 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:23.449620 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:23.449735 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:23.449819 3037 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1013 02:49:23.449872 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:23.449911 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:23.449883 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:23.449922 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:23.449947 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:23.449968 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:23.449992 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:23.450012 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:23.450032 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:23.450085 3037 api.go:53] PageSize not implemented I1013 02:49:23.450109 3037 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1013 02:49:23.450136 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:23.450161 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:23.450159 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:23.450169 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:23.450207 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:23.450223 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:23.450237 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:23.450213 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:23.450266 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:23.450287 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:23.450361 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:23.450390 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:23.450534 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:23.450583 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:23.456180 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:23.456374 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.456540 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.456674 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.456773 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.457343 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:23.457564 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:23.457728 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I1013 02:49:23.459467 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:23.461443 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.461495 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.461525 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.467146 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:23.469465 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.469518 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.469549 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:23.469577 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.222462 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:24.411117 3037 iamrole.go:89] ListRoles: { } I1013 02:49:24.413260 3037 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1013 02:49:24.413527 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:24.413690 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.413847 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:24.413885 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:24.413950 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:24.413992 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:24.414131 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:24.414236 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.414363 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.414488 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:24.414557 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1013 02:49:24.414674 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.415214 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1013 02:49:24.415477 3037 api.go:53] PageSize not implemented I1013 02:49:24.415973 3037 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1013 02:49:24.416095 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:24.416102 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.416266 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:24.416251 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:24.416208 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:24.416337 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:24.416378 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:24.416416 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:24.416413 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:24.416492 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:24.416528 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:24.416488 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.416641 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1013 02:49:24.416790 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:24.416834 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:24.416938 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.417075 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:24.417117 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1013 02:49:24.417248 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:24.417334 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:24.417515 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:24.417574 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:24.417778 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:24.417824 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:24.417911 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:24.418078 3037 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1013 02:49:24.418278 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:24.418400 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:24.418474 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:24.418569 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:24.418681 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:24.418786 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:24.418876 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:24.418933 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:24.419110 3037 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1013 02:49:24.419161 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:24.419203 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:24.419214 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:24.419185 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:24.419236 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:24.419258 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:24.419284 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:24.419307 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:24.419325 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:24.419377 3037 api.go:53] PageSize not implemented I1013 02:49:24.419405 3037 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1013 02:49:24.419449 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:24.419494 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:24.419461 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:24.419514 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:24.419528 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:24.419636 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:24.419543 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:24.419756 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:24.419793 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:24.419852 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:24.419900 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:24.419921 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:24.419995 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:24.420023 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:24.425616 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:24.425732 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.425825 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.425922 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.426017 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.426329 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:24.426513 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:24.426700 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:49:24.426748 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:24.426783 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:24.426851 3037 dns.go:235] Pre-creating DNS records I1013 02:49:24.434902 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1013 02:49:24.439070 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.439166 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.439224 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:24.439272 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:25.187135 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:25.367798 3037 iamrole.go:89] ListRoles: { } I1013 02:49:25.369922 3037 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1013 02:49:25.370141 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1013 02:49:25.370370 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:25.370486 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1013 02:49:25.370633 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1013 02:49:25.370798 3037 api.go:53] PageSize not implemented I1013 02:49:25.370754 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.370970 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1013 02:49:25.371113 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:25.371146 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:25.371205 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:25.371243 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1013 02:49:25.371334 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.371550 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1013 02:49:25.371831 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.372715 3037 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1013 02:49:25.372800 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:25.372871 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:25.372978 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:25.372924 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.373027 3037 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:25.373027 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1013 02:49:25.373043 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.373140 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:25.373172 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1013 02:49:25.373195 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:25.373246 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1013 02:49:25.373242 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1013 02:49:25.373312 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:25.373334 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:25.373382 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:25.373423 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.373506 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1013 02:49:25.373597 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:25.373623 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.373706 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:25.373731 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1013 02:49:25.373829 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:25.373870 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.373945 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:25.373996 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:25.374105 3037 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1013 02:49:25.374350 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:25.374415 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:25.374543 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:25.374682 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:25.374834 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.374979 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1013 02:49:25.375050 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:25.375186 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:25.375451 3037 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1013 02:49:25.375522 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:25.375548 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:25.375615 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:25.375634 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.375672 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.375707 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1013 02:49:25.375747 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1013 02:49:25.375781 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1013 02:49:25.375813 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1013 02:49:25.375903 3037 api.go:53] PageSize not implemented I1013 02:49:25.375953 3037 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1013 02:49:25.376025 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:25.376055 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:25.376101 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1013 02:49:25.376109 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:25.376124 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:25.376148 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.376178 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:25.376287 3037 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1013 02:49:25.376199 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.376410 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:25.376463 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:25.376486 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.376565 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1013 02:49:25.376594 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.382143 3037 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1013 02:49:25.382258 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:25.382411 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:25.382534 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:25.382709 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:25.383462 3037 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1013 02:49:25.383686 3037 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1013 02:49:25.383988 3037 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1013 02:49:25.384184 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:25.384245 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:25.384286 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:25.384322 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:25.384357 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:25.384394 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:25.384427 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:25.384465 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:25.384511 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:25.384554 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:25.384588 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:25.384622 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:25.384661 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:25.384693 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:25.384730 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:25.384767 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:25.384804 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:25.384840 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:25.384877 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:25.384909 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:25.384947 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1013 02:49:25.384984 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:25.385017 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:25.385050 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:25.385092 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:25.385129 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:25.385166 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:25.387795 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:25.387898 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:25.387920 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:25.387962 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388021 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1013 02:49:25.388088 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388152 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388203 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388259 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388304 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388350 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1013 02:49:25.388406 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388478 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1013 02:49:25.388521 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W1013 02:49:25.388576 3037 api.go:53] PageSize not implemented I1013 02:49:25.388595 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:25.388621 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:25.388638 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1013 02:49:25.388676 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:25.388699 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:25.388718 3037 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" ] } I1013 02:49:25.388786 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:25.388820 3037 iamrole.go:89] ListRoles: { } I1013 02:49:25.388861 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:25.388889 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:25.388937 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:25.388983 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:25.389027 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } autoscaling-group:master-us-test-1a.masters.complex.example.com ok autoscaling-config:lt-1 ok I1013 02:49:25.389587 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1013 02:49:25.389647 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I1013 02:49:25.389631 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1013 02:49:25.389698 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } autoscaling-group:nodes.complex.example.com ok I1013 02:49:25.389695 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok I1013 02:49:25.389742 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } subnet:subnet-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I1013 02:49:25.389739 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1013 02:49:25.389798 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1013 02:49:25.389767 3037 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I1013 02:49:25.389814 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I1013 02:49:25.389824 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:masters.complex.example.com ok I1013 02:49:25.389856 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:25.389878 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1013 02:49:25.389679 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:25.389913 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.complex.example.com. ok I1013 02:49:25.389950 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 } ] } W1013 02:49:25.390163 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:25.390177 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:25.390202 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1013 02:49:25.390235 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:25.390263 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:25.390294 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1013 02:49:25.390411 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:25.390421 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I1013 02:49:25.390476 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I1013 02:49:25.390506 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I1013 02:49:25.390516 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1013 02:49:25.390540 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I1013 02:49:25.390560 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I1013 02:49:25.390585 3037 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I1013 02:49:25.390544 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:25.390592 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1013 02:49:25.390645 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } I1013 02:49:25.390644 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } iam-role:masters.complex.example.com ok subnet:subnet-2 ok I1013 02:49:25.390770 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1013 02:49:25.390854 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:49:25.390936 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (9.98s) === RUN TestLifecycleExternalLB I1013 02:49:25.391436 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:25.391573 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:25.391611 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:25.391651 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:25.391692 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:25.391741 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:25.391783 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:25.391814 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:25.391852 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:25.391881 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I1013 02:49:25.417432 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:25.420558 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:25.420651 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:26.172294 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:26.330261 3037 iamrole.go:89] ListRoles: { } I1013 02:49:26.331948 3037 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1013 02:49:26.332212 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1013 02:49:26.332341 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1013 02:49:26.332359 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:26.332408 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } W1013 02:49:26.332480 3037 api.go:53] PageSize not implemented I1013 02:49:26.332520 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1013 02:49:26.332454 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.332556 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:26.332581 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1013 02:49:26.332711 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:26.332767 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1013 02:49:26.332794 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.332950 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:26.333043 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:26.333078 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.333194 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1013 02:49:26.333346 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I1013 02:49:26.333240 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.333435 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1013 02:49:26.333522 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } W1013 02:49:26.333676 3037 api.go:53] PageSize not implemented I1013 02:49:26.333605 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.333854 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:49:26.333885 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:49:26.333909 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:26.333943 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:26.333979 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:26.334095 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:26.334136 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:26.334230 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.334261 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } W1013 02:49:26.334386 3037 api.go:53] PageSize not implemented I1013 02:49:26.334372 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1013 02:49:26.334436 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1013 02:49:26.335764 3037 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1013 02:49:26.335853 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.335955 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1013 02:49:26.335979 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:26.336031 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1013 02:49:26.335950 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1013 02:49:26.336089 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1013 02:49:26.336223 3037 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1013 02:49:26.336200 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:26.336272 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:26.336389 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1013 02:49:26.336404 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:26.336463 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:26.336509 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:49:26.336549 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:26.336654 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:49:26.336713 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:26.336773 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1013 02:49:26.336913 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:26.336975 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:26.337010 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:26.337035 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.337091 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:26.337166 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1013 02:49:26.337175 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:26.337353 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:26.337403 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:26.337431 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1013 02:49:26.337479 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.337550 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:26.337881 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1013 02:49:26.341735 3037 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1013 02:49:26.341907 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1013 02:49:26.342050 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:26.342158 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:26.342196 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1013 02:49:26.342230 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.342496 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1013 02:49:26.342714 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I1013 02:49:26.342931 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.343076 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:26.343166 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.343318 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:26.343392 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1013 02:49:26.343529 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:26.343663 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:26.343748 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:49:26.343833 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.343991 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" }] }] } I1013 02:49:26.344161 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1013 02:49:26.344303 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1013 02:49:26.344454 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.344581 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.344750 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:49:26.344806 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:26.344902 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:26.344990 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1013 02:49:26.345339 3037 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1013 02:49:26.345603 3037 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1013 02:49:26.345865 3037 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1013 02:49:26.345914 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:26.345950 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:26.346015 3037 dns.go:235] Pre-creating DNS records I1013 02:49:26.346046 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:26.352546 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:26.355736 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:26.355830 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:27.104408 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:27.237387 3037 iamrole.go:89] ListRoles: { } I1013 02:49:27.239089 3037 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1013 02:49:27.239490 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1013 02:49:27.239733 3037 api.go:53] PageSize not implemented I1013 02:49:27.239768 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.239843 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W1013 02:49:27.239930 3037 api.go:53] PageSize not implemented I1013 02:49:27.240340 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } W1013 02:49:27.240778 3037 api.go:53] PageSize not implemented I1013 02:49:27.240695 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1013 02:49:27.240837 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1013 02:49:27.240911 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1013 02:49:27.241173 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:27.241302 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:27.241230 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.241337 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1013 02:49:27.241419 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.241439 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1013 02:49:27.241547 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:27.241595 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1013 02:49:27.241654 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1013 02:49:27.241605 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:27.241792 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:27.242851 3037 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1013 02:49:27.242964 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:27.243065 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I1013 02:49:27.243265 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1013 02:49:27.243315 3037 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1013 02:49:27.243252 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.243498 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1013 02:49:27.243681 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:27.243743 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:27.243908 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.244169 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:27.244245 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1013 02:49:27.244438 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:27.248797 3037 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1013 02:49:27.249054 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:27.249175 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:27.249334 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:27.249487 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:27.249674 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:27.250111 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:27.250243 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:27.250404 3037 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1013 02:49:27.250658 3037 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1013 02:49:27.250945 3037 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1013 02:49:27.253997 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:27.254086 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:27.254131 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:27.254166 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:27.254200 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:27.254233 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:27.254265 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:27.254304 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:27.254340 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:27.254404 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:27.254450 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:27.254484 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:27.254518 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:27.254554 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:27.254589 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:27.254623 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:27.254659 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:27.254696 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:27.254728 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:27.254761 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:27.254794 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:27.254831 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:27.254868 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:27.254903 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:27.256214 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:27.256275 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:27.256295 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:27.256341 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256389 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1013 02:49:27.256443 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256505 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256552 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256605 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256650 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256691 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1013 02:49:27.256741 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256793 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1013 02:49:27.256835 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W1013 02:49:27.256889 3037 api.go:53] PageSize not implemented I1013 02:49:27.256911 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:27.256937 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:27.256954 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:27.256978 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:27.256994 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:27.257045 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:27.257087 3037 iamrole.go:89] ListRoles: { } I1013 02:49:27.257131 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:27.257160 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:27.257205 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:27.257248 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:27.257283 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:27.257756 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-group:nodes.externallb.example.com ok I1013 02:49:27.257836 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I1013 02:49:27.257927 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1013 02:49:27.257948 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:27.258030 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I1013 02:49:27.257875 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.externallb.example.com. ok I1013 02:49:27.258097 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1013 02:49:27.258192 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I1013 02:49:27.258046 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1013 02:49:27.258281 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:27.258312 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:27.258362 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1013 02:49:27.258446 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:27.258503 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1013 02:49:27.258617 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:27.258632 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:27.258665 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1013 02:49:27.258726 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1013 02:49:27.258813 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I1013 02:49:27.258864 3037 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I1013 02:49:27.258832 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:49:27.258880 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1013 02:49:27.258916 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I1013 02:49:27.258952 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I1013 02:49:27.258992 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I1013 02:49:27.259005 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1013 02:49:27.259032 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I1013 02:49:27.259091 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:27.259165 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:49:27.259239 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (1.87s) === RUN TestLifecycleSharedSubnet I1013 02:49:27.259732 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:27.259876 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:27.259915 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:27.259960 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:27.260001 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:27.260051 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:27.260095 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:27.260130 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:27.260169 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:27.260201 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I1013 02:49:27.285106 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:27.288297 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:27.288380 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:28.069227 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:28.212911 3037 iamrole.go:89] ListRoles: { } I1013 02:49:28.213691 3037 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1013 02:49:28.213998 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:28.214163 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:28.214256 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:28.214424 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:28.214520 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I1013 02:49:28.214685 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1013 02:49:28.215168 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:28.215273 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:28.215353 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:28.215515 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I1013 02:49:28.215565 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1013 02:49:28.215956 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:28.216053 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.216739 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:28.216875 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:28.216929 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:28.218269 3037 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1013 02:49:28.218397 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1013 02:49:28.218538 3037 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1013 02:49:28.218584 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:28.218665 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1013 02:49:28.218732 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1013 02:49:28.218728 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:28.218759 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1013 02:49:28.218792 3037 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] } I1013 02:49:28.218887 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1013 02:49:28.219007 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1013 02:49:28.219112 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:28.219223 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:28.219274 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:28.219314 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1013 02:49:28.219500 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }], VpcId: "vpc-12345678" } I1013 02:49:28.219586 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:28.219632 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:28.220393 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1013 02:49:28.224646 3037 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1013 02:49:28.224853 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.225052 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.225227 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.225486 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.225660 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.225922 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:28.226042 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:28.226190 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.226503 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.226649 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.226755 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1013 02:49:28.226863 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.226959 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1013 02:49:28.227050 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1013 02:49:28.227159 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:28.227231 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:28.227336 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1013 02:49:28.227588 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" }] }] } I1013 02:49:28.227789 3037 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1013 02:49:28.228066 3037 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1013 02:49:28.228340 3037 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1013 02:49:28.228393 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:28.228433 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:28.228502 3037 dns.go:235] Pre-creating DNS records I1013 02:49:28.228532 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:28.234349 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:28.237543 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:28.237637 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.172249 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:29.333078 3037 iamrole.go:89] ListRoles: { } I1013 02:49:29.334453 3037 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1013 02:49:29.334814 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:29.335192 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:29.335328 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.335451 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:29.335518 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:29.335538 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:29.335564 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.336667 3037 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1013 02:49:29.336905 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1013 02:49:29.336809 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1013 02:49:29.336930 3037 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1013 02:49:29.336967 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1013 02:49:29.337027 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1013 02:49:29.337206 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:29.337269 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:29.337337 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:29.340039 3037 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1013 02:49:29.340311 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.340406 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.340456 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.340555 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.340824 3037 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1013 02:49:29.340939 3037 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1013 02:49:29.341091 3037 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1013 02:49:29.342612 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:29.342648 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:29.342668 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:29.342687 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:29.342705 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:29.342722 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:29.342743 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:29.342768 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:29.342788 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:29.342808 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:29.342825 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:29.342846 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:29.342865 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:29.342885 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:29.342904 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:29.342923 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:29.342941 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:29.342960 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:29.342981 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:29.343771 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:29.343809 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:29.343819 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:29.343839 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.343866 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1013 02:49:29.343899 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.343937 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.343961 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.343984 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.344009 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.344046 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1013 02:49:29.344071 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.344098 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1013 02:49:29.344116 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W1013 02:49:29.344147 3037 api.go:53] PageSize not implemented I1013 02:49:29.344160 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:29.344176 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:29.344188 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:29.344201 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:29.344214 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1013 02:49:29.344246 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:29.344270 3037 iamrole.go:89] ListRoles: { } I1013 02:49:29.344297 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:29.344315 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:29.344342 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:29.344365 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:29.344578 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:29.344624 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok autoscaling-group:nodes.sharedsubnet.example.com ok I1013 02:49:29.344664 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I1013 02:49:29.344719 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:29.344617 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I1013 02:49:29.344689 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1013 02:49:29.344750 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } I1013 02:49:29.344803 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok W1013 02:49:29.344828 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:29.344887 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:29.344867 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1013 02:49:29.344953 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I1013 02:49:29.344942 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:masters.sharedsubnet.example.com ok I1013 02:49:29.344998 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1013 02:49:29.345134 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:29.345151 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I1013 02:49:29.345202 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I1013 02:49:29.345234 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1013 02:49:29.345250 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1013 02:49:29.345287 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok I1013 02:49:29.345308 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I1013 02:49:29.345333 3037 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1013 02:49:29.345341 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1013 02:49:29.345361 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (2.09s) === RUN TestLifecyclePrivateSharedSubnet I1013 02:49:29.345629 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:29.345710 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:29.345734 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:29.345760 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:29.345786 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:29.345816 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:29.345844 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:29.345867 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:29.345890 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:29.345907 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I1013 02:49:29.372752 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:29.376192 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.376277 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:29.376337 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.133745 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:30.290644 3037 iamrole.go:89] ListRoles: { } I1013 02:49:30.292575 3037 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1013 02:49:30.293021 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:30.293164 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I1013 02:49:30.293280 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1013 02:49:30.293347 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:30.293378 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I1013 02:49:30.293278 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:30.293449 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" }] } I1013 02:49:30.293538 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:30.293621 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:30.293715 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:30.293770 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:30.293808 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I1013 02:49:30.293870 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I1013 02:49:30.294121 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:30.294308 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:30.294447 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:30.294531 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:30.294729 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.296624 3037 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1013 02:49:30.296857 3037 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1013 02:49:30.296892 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1013 02:49:30.296931 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1013 02:49:30.297005 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1013 02:49:30.297165 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1013 02:49:30.297144 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:30.297242 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1013 02:49:30.297289 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:30.297322 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1013 02:49:30.297381 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1013 02:49:30.297441 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1013 02:49:30.297574 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1013 02:49:30.297530 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1013 02:49:30.297622 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1013 02:49:30.297710 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1013 02:49:30.297879 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:30.297981 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:30.297991 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1013 02:49:30.298032 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:30.298058 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1013 02:49:30.298084 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:30.298145 3037 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I1013 02:49:30.298225 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1013 02:49:30.298314 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:30.298400 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1013 02:49:30.298513 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:30.298549 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I1013 02:49:30.298644 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:30.298690 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:30.298729 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:30.298787 3037 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/role/internal-elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" }] } I1013 02:49:30.298862 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:30.298951 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:30.298997 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:30.300120 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1013 02:49:30.300595 3037 executor.go:111] Tasks: 72 done / 123 total; 31 can run W1013 02:49:30.300953 3037 api.go:53] PageSize not implemented I1013 02:49:30.300812 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.301042 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:30.301062 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:30.301147 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:30.301099 3037 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I1013 02:49:30.301131 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1013 02:49:30.301221 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:30.301258 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.301262 3037 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I1013 02:49:30.301349 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.301354 3037 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1013 02:49:30.301440 3037 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1013 02:49:30.301485 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" }] }] } I1013 02:49:30.301670 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.301934 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.302129 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I1013 02:49:30.302266 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1013 02:49:30.302318 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } I1013 02:49:30.302307 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } W1013 02:49:30.302405 3037 api.go:53] PageSize not implemented I1013 02:49:30.302426 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:30.302406 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1013 02:49:30.302493 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1013 02:49:30.302576 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I1013 02:49:30.302637 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1013 02:49:30.302720 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.302798 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.302873 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:30.302929 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.303006 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:30.303062 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.303125 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.303186 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1013 02:49:30.303245 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I1013 02:49:30.303320 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1013 02:49:30.303398 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1013 02:49:30.303482 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.303560 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1013 02:49:30.303663 3037 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1013 02:49:30.303698 3037 api.go:53] PageSize not implemented I1013 02:49:30.303720 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W1013 02:49:30.303779 3037 api.go:53] PageSize not implemented I1013 02:49:30.303751 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:30.303829 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:30.303898 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:30.304001 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:30.304143 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:30.306942 3037 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1013 02:49:30.307106 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.307165 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.307266 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.307340 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.307750 3037 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1013 02:49:30.307931 3037 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1013 02:49:30.308156 3037 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1013 02:49:30.308221 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:30.308279 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:30.308378 3037 dns.go:235] Pre-creating DNS records I1013 02:49:30.308418 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:30.314833 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:30.318375 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.318481 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:30.318575 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.065403 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:31.247688 3037 iamrole.go:89] ListRoles: { } I1013 02:49:31.249617 3037 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1013 02:49:31.250041 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:31.250118 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:31.250431 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.250805 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.251024 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:31.251090 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:31.251113 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:31.252831 3037 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1013 02:49:31.252977 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1013 02:49:31.253105 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1013 02:49:31.253199 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1013 02:49:31.253267 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1013 02:49:31.253307 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1013 02:49:31.253297 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:31.253339 3037 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1013 02:49:31.253296 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1013 02:49:31.253380 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1013 02:49:31.253371 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1013 02:49:31.253571 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1013 02:49:31.253749 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:31.253808 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1013 02:49:31.253954 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:31.254009 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:31.254140 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1013 02:49:31.254281 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:31.254668 3037 executor.go:111] Tasks: 72 done / 123 total; 31 can run W1013 02:49:31.254933 3037 api.go:53] PageSize not implemented I1013 02:49:31.254964 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.255014 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1013 02:49:31.255055 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.255111 3037 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } W1013 02:49:31.255078 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:31.255086 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.255218 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1013 02:49:31.255248 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.255287 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1013 02:49:31.255324 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1013 02:49:31.255365 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1013 02:49:31.255403 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W1013 02:49:31.255527 3037 api.go:53] PageSize not implemented I1013 02:49:31.255551 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.255634 3037 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1013 02:49:31.255694 3037 api.go:53] PageSize not implemented I1013 02:49:31.255733 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.255769 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:31.255863 3037 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1013 02:49:31.255894 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.255884 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1013 02:49:31.255970 3037 api.go:53] PageSize not implemented I1013 02:49:31.255984 3037 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1013 02:49:31.256012 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.256239 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.261393 3037 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1013 02:49:31.261602 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.261740 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.261808 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.261983 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.262711 3037 executor.go:111] Tasks: 115 done / 123 total; 2 can run W1013 02:49:31.262806 3037 api.go:53] PageSize not implemented I1013 02:49:31.262829 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.263010 3037 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1013 02:49:31.263254 3037 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1013 02:49:31.266495 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:31.266560 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:31.266595 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:31.266631 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:31.266667 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:31.266702 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:31.266740 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:31.266777 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:31.266819 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1013 02:49:31.266856 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:31.266888 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:31.266921 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:31.266952 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:31.266986 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:31.267036 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:31.267074 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:31.267108 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:31.267142 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:31.267179 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:31.267213 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:31.267250 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:31.267286 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:31.268786 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:31.268853 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:31.268874 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:31.268917 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.268975 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1013 02:49:31.269041 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269105 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269150 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269193 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269242 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269280 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1013 02:49:31.269318 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269359 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1013 02:49:31.269395 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W1013 02:49:31.269439 3037 api.go:53] PageSize not implemented I1013 02:49:31.269456 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1013 02:49:31.269496 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:31.269522 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:31.269537 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1013 02:49:31.269573 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:31.269597 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:31.269613 3037 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I1013 02:49:31.269682 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:31.269722 3037 iamrole.go:89] ListRoles: { } I1013 02:49:31.269764 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:31.269791 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:31.269832 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:31.269880 3037 routetable.go:53] DescribeRouteTables: { } autoscaling-config:lt-2 ok I1013 02:49:31.270447 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } autoscaling-config:lt-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok autoscaling-config:lt-3 ok I1013 02:49:31.270553 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1013 02:49:31.270606 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok autoscaling-group:nodes.private-shared-subnet.example.com ok I1013 02:49:31.270586 3037 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I1013 02:49:31.270593 3037 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok I1013 02:49:31.270678 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:31.270448 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-group:bastion.private-shared-subnet.example.com ok I1013 02:49:31.270821 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1013 02:49:31.270904 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-subnet.example.com. ok I1013 02:49:31.270764 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } iam-instance-profile:nodes.private-shared-subnet.example.com ok W1013 02:49:31.270962 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:31.270943 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1013 02:49:31.270992 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I1013 02:49:31.270995 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1013 02:49:31.271044 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1013 02:49:31.271111 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:31.271170 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1013 02:49:31.271219 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:31.271276 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1013 02:49:31.271399 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:31.271420 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:31.271452 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:31.271497 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1013 02:49:31.271683 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:31.271697 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:31.271774 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:31.271801 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I1013 02:49:31.271884 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1013 02:49:31.271904 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1013 02:49:31.271949 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I1013 02:49:31.271838 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1013 02:49:31.272000 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:31.271982 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I1013 02:49:31.272015 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1013 02:49:31.272040 3037 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1013 02:49:31.272056 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1013 02:49:31.272089 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I1013 02:49:31.272130 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I1013 02:49:31.272196 3037 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1013 02:49:31.272216 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1013 02:49:31.272259 3037 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (1.93s) === RUN TestLifecyclePrivateSharedIP I1013 02:49:31.272765 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:31.272919 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:31.272957 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:31.273001 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:31.273046 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:31.273100 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:31.273145 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:31.273180 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:31.273224 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:31.273256 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I1013 02:49:31.306361 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:31.310286 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.310370 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:31.310438 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.059378 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:32.208126 3037 iamrole.go:89] ListRoles: { } I1013 02:49:32.209368 3037 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1013 02:49:32.209557 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I1013 02:49:32.209623 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1013 02:49:32.209811 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I1013 02:49:32.209869 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" }] } I1013 02:49:32.209885 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:32.210108 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.210276 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:32.210360 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:32.210392 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:32.211273 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I1013 02:49:32.211328 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-ip.example.com" }] } I1013 02:49:32.211336 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:32.211457 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:32.211680 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:32.211830 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:32.211896 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:32.211887 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:32.212006 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:32.213124 3037 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1013 02:49:32.213246 3037 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1013 02:49:32.213304 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1013 02:49:32.213347 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:32.213414 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:32.213478 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1013 02:49:32.213493 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I1013 02:49:32.213458 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:32.213554 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1013 02:49:32.213647 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1013 02:49:32.213648 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1013 02:49:32.213680 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I1013 02:49:32.213698 3037 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1013 02:49:32.213779 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1013 02:49:32.213832 3037 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1013 02:49:32.213869 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1013 02:49:32.213823 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1013 02:49:32.213986 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1013 02:49:32.214150 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1013 02:49:32.214426 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:32.214590 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:32.214589 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1013 02:49:32.214656 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:32.214799 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:32.214682 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1013 02:49:32.214946 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1013 02:49:32.214993 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1013 02:49:32.215171 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:32.215342 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:32.215450 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1013 02:49:32.215554 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1013 02:49:32.215671 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1013 02:49:32.215843 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:32.215832 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I1013 02:49:32.215929 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:32.216016 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:32.216086 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:32.216155 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1013 02:49:32.216259 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:32.216324 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:32.216397 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:32.216465 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:32.216514 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:32.216595 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:32.216645 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:32.216714 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:32.216762 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:32.216824 3037 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I1013 02:49:32.216955 3037 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1013 02:49:32.217137 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:32.217204 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:32.217253 3037 loadbalancers.go:35] PageSize not implemented W1013 02:49:32.217296 3037 api.go:53] PageSize not implemented I1013 02:49:32.217316 3037 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }], Type: "network" } I1013 02:49:32.217299 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.217465 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.217575 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.217482 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:32.217673 3037 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1013 02:49:32.217685 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.217754 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:32.217790 3037 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1013 02:49:32.217802 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.217860 3037 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1013 02:49:32.217934 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.218058 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I1013 02:49:32.218180 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.218260 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1013 02:49:32.218320 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.218394 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:32.218451 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:32.218492 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1013 02:49:32.218531 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" }] }] } I1013 02:49:32.218616 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.218694 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:32.218721 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1013 02:49:32.218765 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1013 02:49:32.218771 3037 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I1013 02:49:32.218831 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } W1013 02:49:32.218895 3037 api.go:53] PageSize not implemented I1013 02:49:32.218917 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:32.218916 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:32.218955 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:32.219012 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.219095 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1013 02:49:32.219170 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1013 02:49:32.219201 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" }] }] } I1013 02:49:32.219278 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.219343 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.219403 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.219486 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:32.219513 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1013 02:49:32.219535 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" }] }] } I1013 02:49:32.219619 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" }] }] } I1013 02:49:32.219699 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.219775 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:32.219860 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:32.219900 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1013 02:49:32.220108 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1013 02:49:32.220222 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1013 02:49:32.220273 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1013 02:49:32.220315 3037 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I1013 02:49:32.220397 3037 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1013 02:49:32.220476 3037 api.go:53] PageSize not implemented I1013 02:49:32.220489 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:32.220508 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:32.220575 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:32.220600 3037 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:32.220522 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W1013 02:49:32.220722 3037 api.go:53] PageSize not implemented I1013 02:49:32.220760 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:32.220733 3037 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }] }] } I1013 02:49:32.220636 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:32.220833 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1013 02:49:32.220877 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:32.220853 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:32.220916 3037 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1013 02:49:32.224263 3037 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1013 02:49:32.224511 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:32.224667 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1013 02:49:32.224823 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.224924 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.225039 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.225163 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.225879 3037 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1013 02:49:32.226282 3037 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1013 02:49:32.226602 3037 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1013 02:49:32.226658 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:32.226694 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:32.226760 3037 dns.go:235] Pre-creating DNS records I1013 02:49:32.226785 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:32.233076 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:32.236543 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.236633 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.236694 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:32.989560 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:33.146394 3037 iamrole.go:89] ListRoles: { } I1013 02:49:33.148481 3037 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1013 02:49:33.149106 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:33.149233 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.149560 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1013 02:49:33.149658 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:33.149676 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1013 02:49:33.149714 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1013 02:49:33.150551 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.152237 3037 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1013 02:49:33.152386 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.152511 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1013 02:49:33.152594 3037 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1013 02:49:33.152624 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:33.152695 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1013 02:49:33.152663 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1013 02:49:33.152716 3037 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1013 02:49:33.152819 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1013 02:49:33.152852 3037 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1013 02:49:33.152775 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1013 02:49:33.152860 3037 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1013 02:49:33.152929 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:33.153026 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1013 02:49:33.153232 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:33.153327 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.153485 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1013 02:49:33.153686 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:33.153785 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.153956 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1013 02:49:33.154015 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I1013 02:49:33.154179 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:33.154432 3037 executor.go:111] Tasks: 74 done / 132 total; 36 can run W1013 02:49:33.154651 3037 api.go:53] PageSize not implemented I1013 02:49:33.154695 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.154786 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:33.154830 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.154924 3037 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1013 02:49:33.154888 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1013 02:49:33.154988 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:33.154982 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:33.155075 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:33.155097 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1013 02:49:33.155149 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1013 02:49:33.155148 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.155188 3037 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1013 02:49:33.155246 3037 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1013 02:49:33.155273 3037 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1013 02:49:33.155267 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1013 02:49:33.155325 3037 api.go:53] PageSize not implemented I1013 02:49:33.155380 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.155436 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:33.155623 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:33.155713 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.155859 3037 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1013 02:49:33.155944 3037 api.go:53] PageSize not implemented I1013 02:49:33.155941 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:33.155935 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:33.156015 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:33.155990 3037 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1013 02:49:33.155996 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.156052 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1013 02:49:33.156149 3037 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" W1013 02:49:33.156167 3037 api.go:53] PageSize not implemented I1013 02:49:33.156224 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.156438 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.156509 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.161871 3037 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1013 02:49:33.161986 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.162103 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1013 02:49:33.162213 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.162375 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.162532 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.162987 3037 executor.go:111] Tasks: 124 done / 132 total; 2 can run W1013 02:49:33.163096 3037 api.go:53] PageSize not implemented I1013 02:49:33.163122 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.163309 3037 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1013 02:49:33.163498 3037 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1013 02:49:33.165356 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:33.165403 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:33.165425 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:33.165447 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:33.165465 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:33.165484 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:33.165504 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:33.165526 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:33.165550 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1013 02:49:33.165570 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1013 02:49:33.165588 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:33.165606 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:33.165624 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:33.165645 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:33.165664 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1013 02:49:33.165683 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:33.165702 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:33.165722 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1013 02:49:33.165742 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1013 02:49:33.165761 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:33.165782 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:33.165799 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1013 02:49:33.165821 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:33.165840 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:33.165857 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:33.165878 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:33.165898 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:33.166713 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:33.166757 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:33.166768 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:33.166791 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.166826 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1013 02:49:33.166863 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.166901 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.166927 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.166953 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.166978 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.167004 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1013 02:49:33.167037 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.167070 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:33.167087 3037 natgateway.go:117] DescribeNatGateways: { } I1013 02:49:33.167112 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1013 02:49:33.167133 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W1013 02:49:33.167160 3037 api.go:53] PageSize not implemented I1013 02:49:33.167169 3037 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1013 02:49:33.167194 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:33.167209 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:33.167218 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1013 02:49:33.167242 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:33.167255 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:33.167264 3037 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I1013 02:49:33.167299 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:33.167323 3037 iamrole.go:89] ListRoles: { } I1013 02:49:33.167353 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:33.167382 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:33.167412 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:33.167438 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:33.167461 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1013 02:49:33.167486 3037 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1013 02:49:33.167507 3037 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1013 02:49:33.167855 3037 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I1013 02:49:33.167902 3037 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I1013 02:49:33.167941 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:bastion.private-shared-ip.example.com ok autoscaling-config:lt-2 ok autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I1013 02:49:33.168064 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1013 02:49:33.168141 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok autoscaling-group:nodes.private-shared-ip.example.com ok I1013 02:49:33.167951 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-ip.example.com. ok I1013 02:49:33.168207 3037 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-3 ok I1013 02:49:33.168306 3037 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I1013 02:49:33.168359 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:33.168393 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1013 02:49:33.168422 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W1013 02:49:33.168516 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:33.168527 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1013 02:49:33.168502 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1013 02:49:33.168551 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1013 02:49:33.168557 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I1013 02:49:33.168578 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:33.168600 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1013 02:49:33.168684 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I1013 02:49:33.168605 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1013 02:49:33.168738 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:33.168760 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I1013 02:49:33.168809 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:33.168865 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1013 02:49:33.169076 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:33.169091 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:33.169182 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I1013 02:49:33.169232 3037 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1013 02:49:33.169250 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1013 02:49:33.169225 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1013 02:49:33.169286 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I1013 02:49:33.169323 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:49:33.169325 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I1013 02:49:33.169375 3037 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1013 02:49:33.169376 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1013 02:49:33.169391 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1013 02:49:33.169430 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W1013 02:49:33.169544 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:33.169561 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1013 02:49:33.169510 3037 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I1013 02:49:33.169613 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I1013 02:49:33.169662 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1013 02:49:33.169678 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1013 02:49:33.169707 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I1013 02:49:33.169774 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:33.169837 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (1.90s) === RUN TestLifecycleManyAddons I1013 02:49:33.170340 3037 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:49:33.170476 3037 internetgateways.go:66] CreateInternetGateway: { } I1013 02:49:33.170515 3037 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:49:33.170556 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:49:33.170597 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:49:33.170648 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:49:33.170692 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:49:33.170750 3037 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:49:33.170789 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:49:33.170817 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1013 02:49:33.197572 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:33.201067 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.201153 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:33.955725 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:34.701169 3037 iamrole.go:89] ListRoles: { } I1013 02:49:34.702705 3037 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1013 02:49:34.702883 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.703063 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:34.703195 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:34.703239 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.703376 3037 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.703452 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1013 02:49:34.703404 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1013 02:49:34.703484 3037 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1013 02:49:34.703511 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:34.703506 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1013 02:49:34.703549 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:34.703609 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:34.703738 3037 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1013 02:49:34.703766 3037 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1013 02:49:34.703836 3037 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1013 02:49:34.704137 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:34.704364 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.704637 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.704820 3037 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.704911 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:34.704942 3037 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1013 02:49:34.705018 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:34.707666 3037 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1013 02:49:34.707815 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.707901 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:49:34.708001 3037 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1013 02:49:34.708045 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1013 02:49:34.707987 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:34.708115 3037 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:49:34.708174 3037 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:49:34.708276 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:49:34.708284 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1013 02:49:34.708538 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.708743 3037 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1013 02:49:34.708743 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1013 02:49:34.708956 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:34.709051 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1013 02:49:34.709110 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:34.709210 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:34.709243 3037 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1013 02:49:34.709288 3037 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1013 02:49:34.709373 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:34.709428 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:34.709472 3037 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1013 02:49:34.709534 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:34.709579 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:34.709624 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:34.709679 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:34.709717 3037 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1013 02:49:34.709799 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:34.709850 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:34.709892 3037 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1013 02:49:34.710193 3037 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:49:34.711837 3037 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1013 02:49:34.711982 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.712139 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:34.712226 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:34.712389 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1013 02:49:34.712445 3037 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1013 02:49:34.712491 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.712663 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.712881 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1013 02:49:34.713098 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.713238 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:34.713316 3037 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:49:34.713373 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1013 02:49:34.713504 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" }] }] } I1013 02:49:34.713650 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1013 02:49:34.713774 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.713904 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I1013 02:49:34.714067 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.714220 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:34.714324 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:34.714391 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.714512 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.714599 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:34.714663 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:34.714764 3037 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.714979 3037 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1013 02:49:34.715040 3037 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1013 02:49:34.715266 3037 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1013 02:49:34.715524 3037 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1013 02:49:34.715751 3037 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1013 02:49:34.715782 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:34.715805 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:34.715846 3037 dns.go:235] Pre-creating DNS records I1013 02:49:34.715865 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:34.719363 3037 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1013 02:49:34.721345 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:34.721395 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:35.470530 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:36.237036 3037 iamrole.go:89] ListRoles: { } I1013 02:49:36.238216 3037 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1013 02:49:36.238479 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.238659 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:49:36.238699 3037 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:49:36.238792 3037 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1013 02:49:36.239042 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:36.239124 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.239375 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.239753 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.239907 3037 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1013 02:49:36.242057 3037 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1013 02:49:36.242197 3037 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1013 02:49:36.242184 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1013 02:49:36.242372 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:36.242504 3037 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1013 02:49:36.242435 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1013 02:49:36.242617 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:36.242686 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:36.242832 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.242976 3037 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:49:36.243066 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.243198 3037 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:49:36.243239 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1013 02:49:36.248073 3037 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1013 02:49:36.248348 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:36.248478 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:36.248662 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:36.248859 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:36.249034 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:36.249211 3037 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1013 02:49:36.249518 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:36.249693 3037 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1013 02:49:36.249994 3037 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1013 02:49:36.250238 3037 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1013 02:49:36.253292 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1013 02:49:36.253358 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1013 02:49:36.253398 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1013 02:49:36.253432 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1013 02:49:36.253466 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1013 02:49:36.253499 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1013 02:49:36.253532 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1013 02:49:36.253568 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1013 02:49:36.253602 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1013 02:49:36.253645 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1013 02:49:36.253684 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1013 02:49:36.253716 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1013 02:49:36.253748 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1013 02:49:36.253783 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1013 02:49:36.253815 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:49:36.253851 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1013 02:49:36.253882 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:49:36.253918 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1013 02:49:36.253949 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1013 02:49:36.253982 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1013 02:49:36.254014 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1013 02:49:36.254079 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1013 02:49:36.254121 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:49:36.254156 3037 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1013 02:49:36.255815 3037 delete_cluster.go:128] Looking for cloud resources to delete W1013 02:49:36.255878 3037 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1013 02:49:36.255898 3037 keypairs.go:95] DescribeKeyPairs: { } I1013 02:49:36.255939 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.255989 3037 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1013 02:49:36.256047 3037 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256104 3037 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256150 3037 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256204 3037 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256247 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256285 3037 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1013 02:49:36.256331 3037 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256380 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1013 02:49:36.256419 3037 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1013 02:49:36.256463 3037 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1013 02:49:36.256502 3037 api.go:53] PageSize not implemented I1013 02:49:36.256524 3037 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1013 02:49:36.256550 3037 loadbalancers.go:35] PageSize not implemented I1013 02:49:36.256573 3037 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1013 02:49:36.256597 3037 targetgroups.go:35] PageSize not implemented I1013 02:49:36.256616 3037 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1013 02:49:36.256667 3037 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1013 02:49:36.256704 3037 iamrole.go:89] ListRoles: { } I1013 02:49:36.256748 3037 zones.go:93] ListHostedZonesPages { } I1013 02:49:36.256778 3037 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1013 02:49:36.256819 3037 internetgateways.go:101] DescribeInternetGateways: { } I1013 02:49:36.256861 3037 routetable.go:53] DescribeRouteTables: { } I1013 02:49:36.256896 3037 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1013 02:49:36.257326 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1013 02:49:36.257407 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:49:36.257431 3037 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1013 02:49:36.257488 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok iam-instance-profile:masters.minimal.example.com ok autoscaling-group:nodes.minimal.example.com ok I1013 02:49:36.257530 3037 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:49:36.257616 3037 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1013 02:49:36.257527 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } I1013 02:49:36.257626 3037 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } W1013 02:49:36.257833 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I1013 02:49:36.257858 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1013 02:49:36.257905 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1013 02:49:36.257971 3037 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1013 02:49:36.258031 3037 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1013 02:49:36.258097 3037 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1013 02:49:36.258152 3037 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1013 02:49:36.258184 3037 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W1013 02:49:36.258298 3037 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1013 02:49:36.258311 3037 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1013 02:49:36.258383 3037 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1013 02:49:36.258402 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1013 02:49:36.258469 3037 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1013 02:49:36.258487 3037 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1013 02:49:36.258537 3037 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1013 02:49:36.258553 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1013 02:49:36.258589 3037 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1013 02:49:36.258636 3037 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1013 02:49:36.258696 3037 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1013 02:49:36.258782 3037 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1013 02:49:36.258865 3037 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1013 02:49:36.258940 3037 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (3.09s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 149.357s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I1013 02:47:08.019034 3299 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I1013 02:47:08.050185 3302 pod.go:59] starting pod controller I1013 02:47:08.050411 3302 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) I1013 02:47:08.050510 3302 pod.go:107] Got stop signal PASS I1013 02:47:08.050532 3302 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.041s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00010f330} route53_test.go:93: Got zone list: [0xc00010f360] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001100c0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00010f490} route53_test.go:93: Got zone list: [0xc00010f4c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001100d8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc00010f5c0} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003be5d0 0xc0001100f8} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00010f780} route53_test.go:93: Got zone list: [0xc00010f7b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110118} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00010f910} route53_test.go:93: Got zone list: [0xc00010f940] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110140} route53_test.go:187: Successfully added resource record set: {0xc000166700 0xc000110160} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00010fc20} route53_test.go:93: Got zone list: [0xc00010fc50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001101f0} route53_test.go:199: Successfully added resource record set: {0xc000166880 0xc000110210} route53_test.go:118: Got 1 recordsets: [0xc00010fdf0] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00010ff80} route53_test.go:93: Got zone list: [0xc00010ffb0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001102b0} route53_test.go:221: Successfully added resource record set: {0xc000166a00 0xc0001102d0} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000166a00 0xc0001102d0}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d0370} route53_test.go:93: Got zone list: [0xc0003d03a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110390} route53_test.go:246: Successfully removed resource set {0xc000166c00 0xc0001103b0} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d0680} route53_test.go:93: Got zone list: [0xc0003d06b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110440} route53_test.go:264: Successfully removed resource set {0xc000166d80 0xc000110460} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d09c0} route53_test.go:93: Got zone list: [0xc0003d09f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001104f8} commontests.go:192: Successfully added resource record set: {0xc000166f00 0xc000110518} commontests.go:45: Correctly replaced resource record {0xc000166f00 0xc000110518} -> {0xc000167000 0xc000110568} commontests.go:142: Got 1 recordsets: [0xc0003d0d00] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d0f30} route53_test.go:93: Got zone list: [0xc0003d0f60] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110620} commontests.go:192: Successfully added resource record set: {0xc000167280 0xc000110640} commontests.go:70: Correctly replaced resource record {0xc000167280 0xc000110640} -> {0xc000167380 0xc000110690} commontests.go:142: Got 1 recordsets: [0xc0003d1270] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d14f0} route53_test.go:93: Got zone list: [0xc0003d1520] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110758} commontests.go:192: Successfully added resource record set: {0xc000167600 0xc000110778} commontests.go:142: Got 2 recordsets: [0xc0003d1790 0xc0003d17b0] commontests.go:142: Got 2 recordsets: [0xc0003d1820 0xc0003d1840] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d1a40} route53_test.go:93: Got zone list: [0xc0003d1a70] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000110880} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.016s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c0c60} clouddns_test.go:71: Got zone list: [0xc0002fc900] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fc8d0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c0d60} clouddns_test.go:71: Got zone list: [0xc0002fc9c0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fc990} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c0e60} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc0002c3380 0xc0002fca80} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c0f20} clouddns_test.go:71: Got zone list: [0xc0002fcb40] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fcb10} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c1040} clouddns_test.go:71: Got zone list: [0xc0002fcc78] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fcc48} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c1180} clouddns_test.go:71: Got zone list: [0xc0002fcde0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fcdb0} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c12e0} clouddns_test.go:71: Got zone list: [0xc0002fcff0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fcfc0} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c1440} clouddns_test.go:71: Got zone list: [0xc0002fd188] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fd158} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c1580} clouddns_test.go:71: Got zone list: [0xc0002fd2f0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fd2c0} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c16e0} clouddns_test.go:71: Got zone list: [0xc0002fd4b8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fd488} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c1840} clouddns_test.go:71: Got zone list: [0xc0002fd788] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fd758} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c19c0} clouddns_test.go:71: Got zone list: [0xc0002fdab8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fda88} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071f7e0 0xc0002c1ba0} clouddns_test.go:71: Got zone list: [0xc0002fde90] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0002c3200 0xc0002fde60} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.058s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.032s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.006s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.05s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.110s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I1013 02:47:15.546874 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.547079 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.547124 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.547181 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.547221 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.547305 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.547357 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.547400 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.547463 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.547503 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.558116 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.02s) === RUN TestContainerdBuilder_Docker_19_03_14 I1013 02:47:15.563027 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.563132 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.563164 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.563198 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.563240 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.563283 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.563317 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.563364 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.563395 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.563416 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.564856 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.01s) === RUN TestContainerdBuilder_Simple I1013 02:47:15.569413 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.569516 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.569547 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.569581 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.569611 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.569650 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.569683 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.569707 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.569737 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.569759 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.571214 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.575717 3943 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I1013 02:47:15.575756 3943 assetstore.go:111] bin/containerd I1013 02:47:15.575772 3943 assetstore.go:111] bin/containerd-shim I1013 02:47:15.575786 3943 assetstore.go:111] bin/containerd-shim-runc-v1 I1013 02:47:15.575799 3943 assetstore.go:111] bin/containerd-shim-runc-v2 I1013 02:47:15.575811 3943 assetstore.go:111] bin/containerd-stress I1013 02:47:15.575823 3943 assetstore.go:111] bin/ctr I1013 02:47:15.575929 3943 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I1013 02:47:15.575952 3943 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I1013 02:47:15.582132 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.582269 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.582313 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.582365 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.582417 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.582472 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.582523 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.582557 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.582598 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.582630 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.584489 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.586960 3943 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.01s) === RUN TestContainerdBuilder_SkipInstall I1013 02:47:15.588550 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.588690 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.588733 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.588782 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.588825 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.588880 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.589027 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.589114 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.589194 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.589259 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.591056 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.593980 3943 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.01s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I1013 02:47:15.595188 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.595314 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.595356 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.595405 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.595448 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.595502 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.595630 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.595702 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.595782 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.595845 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.598146 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.601254 3943 assetstore.go:108] Matching assets for "^docker/": I1013 02:47:15.601328 3943 assetstore.go:111] docker/containerd I1013 02:47:15.601384 3943 assetstore.go:111] docker/containerd-shim I1013 02:47:15.601434 3943 assetstore.go:111] docker/ctr I1013 02:47:15.601484 3943 assetstore.go:111] docker/docker I1013 02:47:15.601533 3943 assetstore.go:111] docker/docker-init I1013 02:47:15.601578 3943 assetstore.go:111] docker/docker-proxy I1013 02:47:15.601596 3943 assetstore.go:111] docker/dockerd I1013 02:47:15.601609 3943 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I1013 02:47:15.606362 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.606508 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.606550 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.606589 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.606617 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.606654 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.606712 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.606730 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.606756 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.606774 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.608367 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.611099 3943 assetstore.go:108] Matching assets for "^docker/": I1013 02:47:15.611172 3943 assetstore.go:111] docker/containerd I1013 02:47:15.611224 3943 assetstore.go:111] docker/containerd-shim I1013 02:47:15.611274 3943 assetstore.go:111] docker/ctr I1013 02:47:15.611321 3943 assetstore.go:111] docker/docker I1013 02:47:15.611368 3943 assetstore.go:111] docker/docker-init I1013 02:47:15.611415 3943 assetstore.go:111] docker/docker-proxy I1013 02:47:15.611459 3943 assetstore.go:111] docker/dockerd I1013 02:47:15.611497 3943 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I1013 02:47:15.616060 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.616189 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.616269 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.616350 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.616394 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.616489 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.616575 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.616608 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.616650 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.616716 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.618405 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.621153 3943 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.01s) === RUN TestDockerBuilder_HealthCheck I1013 02:47:15.621520 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.621661 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.621705 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.621789 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.621864 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.621946 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.622074 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.622114 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.622155 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.622189 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.624003 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:15.626381 3943 assetstore.go:108] Matching assets for "^docker/": I1013 02:47:15.626410 3943 assetstore.go:111] docker/docker I1013 02:47:15.626425 3943 assetstore.go:111] docker/docker-containerd I1013 02:47:15.626438 3943 assetstore.go:111] docker/docker-containerd-ctr I1013 02:47:15.626451 3943 assetstore.go:111] docker/docker-containerd-shim I1013 02:47:15.626465 3943 assetstore.go:111] docker/docker-init I1013 02:47:15.626479 3943 assetstore.go:111] docker/docker-proxy I1013 02:47:15.626491 3943 assetstore.go:111] docker/docker-runc I1013 02:47:15.626504 3943 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I1013 02:47:15.630821 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.630932 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.630968 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.631013 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.631048 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.631095 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.631133 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.631162 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.631201 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.631227 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.633658 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I1013 02:47:15.636284 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.636379 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.636413 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.636461 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.636506 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.636556 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.636592 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.636624 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.636661 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.636700 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.641511 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I1013 02:47:15.644398 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.644478 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.644501 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.644527 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.644549 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.644574 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.644597 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.644612 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.644630 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.644644 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.646154 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I1013 02:47:15.651512 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.651607 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.651636 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.651665 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.651686 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.651717 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.651742 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.651756 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.651779 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.651797 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.653789 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.02s) === RUN TestAuditConfigAPIServerBuilder I1013 02:47:15.667432 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.667536 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.667569 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.667608 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.667641 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.667684 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.667721 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.667751 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.667784 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.667806 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.670786 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I1013 02:47:15.684835 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.684977 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.685018 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.685063 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.685099 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.685145 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.685185 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.685213 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.685247 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.685273 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.688285 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I1013 02:47:15.699311 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.699469 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.699539 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.699609 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.699677 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.699754 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.699820 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.699878 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.699943 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.700112 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.702847 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I1013 02:47:15.713250 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.713396 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.713435 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.713488 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.713537 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.713596 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.713635 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.713663 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.713699 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.713725 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.716037 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I1013 02:47:15.725597 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.725687 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.725719 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.725751 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.725775 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.725825 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.725861 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.725883 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.725904 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.725919 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.727871 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.02s) === RUN TestKubeAPIServerBuilderAMD64 I1013 02:47:15.742738 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:15.742881 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:15.742924 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:15.742983 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:15.743025 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:15.743078 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:15.743123 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:15.743154 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:15.743195 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:15.743224 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:15.746371 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.52s) === RUN TestKubeAPIServerBuilderARM64 I1013 02:47:17.261832 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:17.261919 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:17.261945 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:17.261974 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:17.262000 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:17.262033 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:17.262058 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:17.262075 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:17.262098 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:17.262114 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:17.263839 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.20s) === RUN TestKubeControllerManagerBuilder I1013 02:47:18.458628 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:18.458898 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:18.458986 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:18.459373 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:18.459412 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:18.459448 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:18.459475 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:18.459492 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:18.459516 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:18.459534 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:18.461714 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I1013 02:47:18.468054 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:18.468137 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:18.468163 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:18.468192 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:18.468216 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:18.468244 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:18.468269 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:18.468286 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:18.468307 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:18.468322 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:18.470029 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.19s) === RUN TestKubeControllerManagerBuilderARM64 I1013 02:47:19.661799 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:19.661928 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:19.661970 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:19.662020 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:19.662067 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:19.662124 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:19.662171 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:19.662207 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:19.662250 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:19.662282 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:19.665113 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.20s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I1013 02:47:20.865931 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:20.866027 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:20.866056 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:20.866085 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:20.866111 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:20.866144 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:20.866174 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:20.866191 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:20.866214 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:20.866232 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:20.869891 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I1013 02:47:20.873644 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:20.873733 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:20.873762 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:20.873791 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:20.873816 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:20.873850 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:20.873875 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:20.873893 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:20.873915 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:20.873931 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:20.875658 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.20s) === RUN TestKubeProxyBuilderARM64 I1013 02:47:22.072452 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:22.072539 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:22.072565 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:22.072594 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:22.072616 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:22.072648 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:22.072676 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:22.072692 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:22.072713 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:22.072731 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:22.074364 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.19s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I1013 02:47:23.261789 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:23.261974 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:23.262043 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:23.262125 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:23.262197 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:23.262289 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:23.262371 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:23.262446 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:23.262526 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:23.262600 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:23.265466 3943 zones.go:93] ListHostedZonesPages { } W1013 02:47:23.269615 3943 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I1013 02:47:23.272655 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:23.272827 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:23.272903 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:23.272991 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:23.273075 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:23.273166 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:23.273252 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:23.273328 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:23.273405 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:23.273474 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:23.276263 3943 zones.go:93] ListHostedZonesPages { } W1013 02:47:24.464402 3943 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.20s) === RUN TestKubeSchedulerBuilderARM64 I1013 02:47:24.468704 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:24.468831 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:24.468871 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:24.468918 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:24.468954 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:24.469001 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:24.469045 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:24.469072 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:24.469108 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:24.469134 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:24.472210 3943 zones.go:93] ListHostedZonesPages { } W1013 02:47:25.656417 3943 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.19s) === RUN TestKubectlBuilder I1013 02:47:25.659135 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.659247 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.659284 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.659325 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.659363 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.659409 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.659446 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.659474 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.659510 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.659535 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.662097 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:25.664752 3943 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I1013 02:47:25.667513 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.667604 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.667659 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.667695 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.667732 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.667776 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.667813 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.667840 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.667873 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.667897 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.669877 3943 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I1013 02:47:25.675137 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.675230 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.675285 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.675322 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.675357 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.675402 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.675439 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.675467 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.675505 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.675529 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.677477 3943 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I1013 02:47:25.682527 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.682633 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.682666 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.682701 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.682738 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.682780 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.682817 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.682843 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.682876 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.682900 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.685324 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:25.687847 3943 assetstore.go:108] Matching assets for "protokube$": I1013 02:47:25.687874 3943 assetstore.go:111] /opt/kops/bin/protokube I1013 02:47:25.687901 3943 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I1013 02:47:25.687936 3943 assetstore.go:108] Matching assets for "channels$": I1013 02:47:25.687953 3943 assetstore.go:111] /opt/kops/bin/channels I1013 02:47:25.687964 3943 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I1013 02:47:25.689913 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.690030 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.690065 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.690102 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.690137 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.690179 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.690214 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.690243 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.690276 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.690300 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.692809 3943 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I1013 02:47:25.696058 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.696166 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.696202 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.696240 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.696305 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.696358 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.696396 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.696425 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.696457 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.696479 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.699532 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:25.703275 3943 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I1013 02:47:25.703930 3943 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:25.704068 3943 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:25.704111 3943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:25.704160 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:25.704202 3943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:25.704259 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:25.704306 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:25.704341 3943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:25.704383 3943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:25.704455 3943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:25.707424 3943 zones.go:93] ListHostedZonesPages { } I1013 02:47:25.710458 3943 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.01s) PASS ok k8s.io/kops/nodeup/pkg/model 10.246s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.045s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.030s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.031s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E1013 02:47:15.478519 3947 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E1013 02:47:15.478638 3947 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.009s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I1013 02:47:15.550936 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551154 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551218 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551264 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551302 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I1013 02:47:15.551660 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551703 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551726 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551754 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551783 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551804 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551833 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551862 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551891 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551916 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551939 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551966 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.551990 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.552015 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.552041 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.552078 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.552101 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.552123 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1013 02:47:15.552142 3948 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I1013 02:47:15.552297 3948 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I1013 02:47:15.552365 3948 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.095s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.01s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.016s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W1013 02:47:15.592408 3950 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.10s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W1013 02:47:15.593456 3950 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W1013 02:47:15.594353 3950 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W1013 02:47:15.595967 3950 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W1013 02:47:15.597349 3950 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W1013 02:47:15.598473 3950 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W1013 02:47:15.599469 3950 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E1013 02:47:15.600144 3950 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E1013 02:47:15.600157 3950 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E1013 02:47:15.600165 3950 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E1013 02:47:15.600174 3950 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.133s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.067s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.023s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.111s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.093s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.027s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.039s === RUN TestFlagToFalse I1013 02:47:23.005979 5259 featureflag_test.go:32] Created flag Unittest1 I1013 02:47:23.006063 5259 featureflag.go:164] FeatureFlag "UnitTest1"=false I1013 02:47:23.006080 5259 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I1013 02:47:23.006182 5259 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.005s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.039s === RUN TestRenderInstanceGroupZones W1013 02:47:23.030997 5261 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.031s === RUN TestWarmPoolOnlyRoll I1013 02:47:35.571050 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.571141 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.571162 5795 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I1013 02:47:35.571549 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.571573 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.572702 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.572722 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.577919 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.577968 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.577986 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.577998 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.580181 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.580864 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.580957 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.580985 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.582097 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.582119 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.587340 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.587412 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:35.588305 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:35.588365 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.588413 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.589539 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.589557 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.594753 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.594787 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.594805 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.594823 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.595797 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.596509 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.596540 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.597657 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.597678 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.602879 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.602946 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.603840 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.603872 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.604948 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.604968 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.610154 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.610208 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.611334 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.611358 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.612473 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.612493 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.617662 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.617691 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.617702 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.617718 5795 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1013 02:47:35.618319 5795 instancegroups.go:431] Draining the node: "node-2a.local". I1013 02:47:35.618777 5795 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1013 02:47:35.618800 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.619920 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.619942 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.625125 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.625175 5795 instancegroups.go:431] Draining the node: "node-2b.local". I1013 02:47:35.625700 5795 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1013 02:47:35.625722 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.626823 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.626841 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.632066 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.632109 5795 instancegroups.go:431] Draining the node: "node-2c.local". I1013 02:47:35.632608 5795 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1013 02:47:35.632628 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.633736 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.633753 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.638907 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.638933 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I1013 02:47:35.639332 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.639362 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.640484 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.640518 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.640541 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.640550 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.640572 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.641661 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.641695 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.641705 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.641740 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.642840 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.642859 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.642883 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.642900 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.642916 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.644061 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.644104 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.644118 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.644138 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.645260 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.645298 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.645311 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.645331 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.646436 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.646452 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.646495 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.646508 5795 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1013 02:47:35.646526 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.647632 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.647661 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.647672 5795 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1013 02:47:35.647694 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.648790 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1013 02:47:35.648817 5795 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1013 02:47:35.648824 5795 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1013 02:47:35.648837 5795 instancegroups.go:469] waiting for 1ms after terminating instance W1013 02:47:35.649936 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1013 02:47:35.649956 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I1013 02:47:35.650294 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.650320 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.651417 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.651443 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.651460 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.651498 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.651516 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.651528 5795 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.651540 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.652052 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.652453 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.652498 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.652513 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.653612 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.653635 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.653651 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.653682 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:35.654315 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:35.654356 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.654378 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.655477 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.655495 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.655505 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.655517 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.655529 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.655535 5795 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.655557 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.656033 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.656393 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.656409 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.657687 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.657710 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.657720 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.657739 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.658117 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.658134 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.659259 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.659276 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.659285 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.659314 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.659836 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.659858 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.660958 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.660976 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.660984 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.660993 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.661001 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.661008 5795 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.661014 5795 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1013 02:47:35.661442 5795 instancegroups.go:431] Draining the node: "node-2a.local". I1013 02:47:35.661804 5795 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1013 02:47:35.661820 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.662948 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.662965 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.662978 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.662995 5795 instancegroups.go:431] Draining the node: "node-2b.local". I1013 02:47:35.663366 5795 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1013 02:47:35.663382 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.664484 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.664507 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.664521 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.664549 5795 instancegroups.go:431] Draining the node: "node-2c.local". I1013 02:47:35.665134 5795 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1013 02:47:35.665162 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.666263 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.666281 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1013 02:47:35.666291 5795 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1013 02:47:35.666303 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I1013 02:47:35.666458 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I1013 02:47:35.666577 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.666591 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.667689 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.667709 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.672875 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.672925 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.672936 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.672944 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.675148 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.675546 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.675596 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.675614 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.676775 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.676799 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.682122 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.682216 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:35.683049 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:35.683121 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.683151 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.684311 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.684344 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.689480 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.689514 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.689526 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.689535 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.690247 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.690761 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.690791 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.691929 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.691975 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.697170 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.697234 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.698112 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.698150 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.699289 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.699328 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.704536 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.704608 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.705508 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.705554 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.706716 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.706747 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.712202 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.712243 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.712257 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.712266 5795 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1013 02:47:35.713072 5795 instancegroups.go:431] Draining the node: "node-2a.local". I1013 02:47:35.713642 5795 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1013 02:47:35.713677 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.714822 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.714865 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.720092 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.720162 5795 instancegroups.go:431] Draining the node: "node-2b.local". I1013 02:47:35.721848 5795 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1013 02:47:35.722175 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.723334 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.723370 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.728581 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.728671 5795 instancegroups.go:431] Draining the node: "node-2c.local". I1013 02:47:35.729657 5795 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1013 02:47:35.729695 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.730834 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.730863 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.736067 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.736109 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I1013 02:47:35.736287 5795 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I1013 02:47:35.736797 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.736828 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.737951 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.737979 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.737997 5795 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I1013 02:47:35.738341 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.738369 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.739499 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.739522 5795 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1013 02:47:35.739540 5795 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I1013 02:47:35.739782 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.739807 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.739824 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.739840 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I1013 02:47:35.740021 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.740043 5795 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1013 02:47:35.740060 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.740076 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I1013 02:47:35.740322 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.740351 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.741485 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.741512 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.746754 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.746820 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.746841 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.746862 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.747629 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.748796 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.748850 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.748871 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.750008 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.750042 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.750074 5795 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I1013 02:47:35.750392 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.750421 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.751536 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.751563 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.756795 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.756867 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.756892 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.756910 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.757754 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.758491 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.758563 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.758595 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.759716 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.759743 5795 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1013 02:47:35.759757 5795 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I1013 02:47:35.759976 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.759996 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.760004 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.761029 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.761786 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.761821 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.762947 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.762973 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.768184 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.768248 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.769167 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.769201 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.770335 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.770362 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.775560 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.775612 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.776244 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.776269 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.777401 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.777428 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.782667 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.782706 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I1013 02:47:35.782957 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.782975 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.782987 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.782996 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I1013 02:47:35.783132 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.783149 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.783158 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.783166 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I1013 02:47:35.783285 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.783300 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.783308 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.783316 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I1013 02:47:35.783488 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.783502 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.783510 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.784237 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.784715 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.784738 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.785865 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.785889 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.791090 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.791133 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.791692 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.791717 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.792835 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.792860 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.798056 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.798091 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.798597 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.798619 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.799737 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.799760 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.804956 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.804996 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.805018 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.805038 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.805053 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I1013 02:47:35.805278 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.805298 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.805310 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.806230 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.806970 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.807000 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.808091 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.808125 5795 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1013 02:47:35.808142 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.808157 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I1013 02:47:35.808345 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.808364 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.808376 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.809118 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.809575 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.809599 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.810742 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.810778 5795 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1013 02:47:35.810805 5795 instancegroups.go:509] Cluster did not validate within 0s E1013 02:47:35.810827 5795 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I1013 02:47:35.811116 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.811149 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.812288 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.812326 5795 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1013 02:47:35.813438 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.818706 5795 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1013 02:47:35.819846 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.825049 5795 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1013 02:47:35.826190 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.831404 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.831497 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.831524 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.831539 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.832264 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.832912 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.832973 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.833001 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.834401 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.834458 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.839707 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.839800 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:35.840692 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:35.840768 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.840793 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.841915 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.841969 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.847255 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.847329 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.847370 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.847402 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.848499 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.849306 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.849343 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.850496 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.850533 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.855747 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.855817 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.856806 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.856844 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.858002 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.858048 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.863272 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.863336 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.864273 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.864307 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.865459 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.865491 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.870704 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.870746 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.870784 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.870800 5795 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1013 02:47:35.871870 5795 instancegroups.go:431] Draining the node: "node-2a.local". I1013 02:47:35.872651 5795 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1013 02:47:35.872684 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.873837 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.873873 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.879074 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.879132 5795 instancegroups.go:431] Draining the node: "node-2b.local". I1013 02:47:35.880027 5795 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1013 02:47:35.880060 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.881214 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.881249 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.886478 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.886546 5795 instancegroups.go:431] Draining the node: "node-2c.local". I1013 02:47:35.887531 5795 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1013 02:47:35.887565 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.888724 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.888757 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.893968 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.894005 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I1013 02:47:35.894376 5795 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1013 02:47:35.894406 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.895557 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.895587 5795 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1013 02:47:35.896698 5795 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1013 02:47:35.897804 5795 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1013 02:47:35.898958 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.904190 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.904258 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.904278 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.904290 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.904861 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.905295 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.905348 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.905369 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.906521 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.906567 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.911763 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.911822 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:35.912390 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:35.912453 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.912477 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.913599 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.913635 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.918834 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.918876 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.918890 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.918901 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:35.919581 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.920028 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.920053 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.921153 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.921170 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.926320 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.926354 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.926973 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.927002 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.928135 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.928169 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.933358 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.933402 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:35.933962 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:35.933990 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.935117 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.935144 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.940336 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.940363 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.940376 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.940386 5795 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1013 02:47:35.941000 5795 instancegroups.go:431] Draining the node: "node-2a.local". I1013 02:47:35.941493 5795 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1013 02:47:35.941520 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.942644 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.942663 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.947840 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.947882 5795 instancegroups.go:431] Draining the node: "node-2b.local". I1013 02:47:35.948484 5795 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1013 02:47:35.948511 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.949658 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.949679 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.954866 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.954914 5795 instancegroups.go:431] Draining the node: "node-2c.local". I1013 02:47:35.955496 5795 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1013 02:47:35.955530 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.956658 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.956697 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.961893 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.961949 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I1013 02:47:35.962671 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.962696 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.962712 5795 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1013 02:47:35.963496 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:35.964232 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:35.964269 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.965411 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.965443 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.970657 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.970734 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:35.971584 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:35.971620 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.972775 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.972797 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.978026 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.978079 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.02s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I1013 02:47:35.978370 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.978392 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.978404 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:35.979089 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:35.979737 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:35.979800 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:35.979829 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.980964 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.980990 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.991476 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.991568 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:35.992540 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:35.992627 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:35.992661 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:35.993830 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:35.993872 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:35.999097 5795 instancegroups.go:540] Cluster validated. I1013 02:47:35.999141 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.02s) === RUN TestRollingUpdateDisabled I1013 02:47:35.999477 5795 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W1013 02:47:35.999513 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1013 02:47:35.999533 5795 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W1013 02:47:35.999547 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1013 02:47:35.999565 5795 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W1013 02:47:35.999576 5795 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1013 02:47:35.999593 5795 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1013 02:47:35.999607 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I1013 02:47:35.999798 5795 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I1013 02:47:35.999844 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:36.000964 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.000990 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:36.006194 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.006235 5795 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I1013 02:47:36.006291 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.006313 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.006328 5795 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1013 02:47:36.007044 5795 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I1013 02:47:36.007080 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.007099 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.007110 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:36.007889 5795 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1013 02:47:36.007955 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:36.009091 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.009120 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:36.014318 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.014367 5795 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I1013 02:47:36.014385 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.014403 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.014420 5795 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1013 02:47:36.015333 5795 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I1013 02:47:36.015396 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:36.016542 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.016584 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:36.021793 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.021837 5795 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1013 02:47:36.021859 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I1013 02:47:36.022142 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.022172 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.022187 5795 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1013 02:47:36.024086 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:36.024785 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:36.024830 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.025987 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.026033 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.026068 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:36.026095 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:36.027086 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:36.027354 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:36.027409 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.028531 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.028593 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.128992 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.129074 5795 instancegroups.go:431] Draining the node: "node-1e.local". I1013 02:47:36.129125 5795 instancegroups.go:431] Draining the node: "node-1d.local". I1013 02:47:36.130211 5795 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1013 02:47:36.130495 5795 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1013 02:47:36.130545 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.131712 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.131748 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.131778 5795 instancegroups.go:431] Draining the node: "node-1f.local". I1013 02:47:36.132287 5795 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1013 02:47:36.132316 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.133447 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.133513 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.233880 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.233952 5795 instancegroups.go:431] Draining the node: "node-1g.local". I1013 02:47:36.234648 5795 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1013 02:47:36.234686 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.235863 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.235909 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.235924 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I1013 02:47:36.236115 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.236133 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.236142 5795 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1013 02:47:36.238939 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:36.239047 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:36.239831 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:36.240014 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:36.240053 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.241213 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.241318 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.341738 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.341830 5795 instancegroups.go:431] Draining the node: "node-1d.local". I1013 02:47:36.341939 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:36.342989 5795 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1013 02:47:36.343267 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:36.343314 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.344425 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.344451 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.344471 5795 instancegroups.go:431] Draining the node: "node-1e.local". I1013 02:47:36.344906 5795 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1013 02:47:36.344931 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.346046 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.346098 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.446475 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.446531 5795 instancegroups.go:431] Draining the node: "node-1f.local". I1013 02:47:36.447131 5795 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1013 02:47:36.447166 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.448338 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.448386 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.448401 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I1013 02:47:36.448608 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.448627 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.448637 5795 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I1013 02:47:36.449911 5795 instancegroups.go:431] Draining the node: "master-1a.local". I1013 02:47:36.450396 5795 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1013 02:47:36.450464 5795 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1013 02:47:36.450503 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.456222 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.456285 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.456337 5795 instancegroups.go:431] Draining the node: "master-1c.local". I1013 02:47:36.456354 5795 instancegroups.go:431] Draining the node: "master-1b.local". I1013 02:47:36.457125 5795 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1013 02:47:36.457192 5795 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1013 02:47:36.457702 5795 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I1013 02:47:36.457755 5795 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I1013 02:47:36.457788 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.458945 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.459030 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.559428 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.559512 5795 instancegroups.go:431] Draining the node: "master-1e.local". I1013 02:47:36.559529 5795 instancegroups.go:431] Draining the node: "master-1d.local". I1013 02:47:36.560614 5795 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I1013 02:47:36.560691 5795 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I1013 02:47:36.560871 5795 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I1013 02:47:36.560924 5795 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I1013 02:47:36.560963 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.562104 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.562141 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.562178 5795 instancegroups.go:431] Draining the node: "master-1f.local". I1013 02:47:36.562916 5795 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I1013 02:47:36.562967 5795 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I1013 02:47:36.562999 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.564080 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.564139 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.664523 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.664592 5795 instancegroups.go:431] Draining the node: "master-1g.local". I1013 02:47:36.665520 5795 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I1013 02:47:36.665602 5795 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I1013 02:47:36.665651 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.666828 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.666868 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.666889 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.22s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I1013 02:47:36.667129 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.667151 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.667161 5795 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1013 02:47:36.668344 5795 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1013 02:47:36.668389 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:36.669505 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.669533 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.669542 5795 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1013 02:47:36.669576 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:36.670680 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.670705 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.670755 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:36.670768 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:36.671685 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:36.671865 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:36.671895 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.673031 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.673071 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.773490 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.773561 5795 instancegroups.go:431] Draining the node: "node-1d.local". I1013 02:47:36.773589 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:36.774481 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:36.774665 5795 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1013 02:47:36.774703 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.775855 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.775883 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.775911 5795 instancegroups.go:431] Draining the node: "node-1e.local". I1013 02:47:36.776371 5795 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1013 02:47:36.776401 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.777513 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.777565 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.878003 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.878078 5795 instancegroups.go:431] Draining the node: "node-1f.local". I1013 02:47:36.878754 5795 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1013 02:47:36.878806 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.879955 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.879983 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.880014 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I1013 02:47:36.880217 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.880238 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.880246 5795 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1013 02:47:36.881313 5795 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1013 02:47:36.881344 5795 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1013 02:47:36.881370 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:36.882485 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.882516 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.882554 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:36.882572 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:36.883070 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:36.883469 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:36.883497 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.884626 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.884691 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.985756 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.985824 5795 instancegroups.go:431] Draining the node: "node-1d.local". I1013 02:47:36.985847 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:36.986871 5795 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1013 02:47:36.987113 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:36.987155 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.988294 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.988331 5795 instancegroups.go:540] Cluster validated. I1013 02:47:36.988363 5795 instancegroups.go:431] Draining the node: "node-1e.local". I1013 02:47:36.988938 5795 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1013 02:47:36.988976 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:36.990107 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:36.990173 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.090799 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.090876 5795 instancegroups.go:431] Draining the node: "node-1f.local". I1013 02:47:37.091875 5795 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1013 02:47:37.091936 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.093095 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.093123 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.093137 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I1013 02:47:37.093322 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.093336 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.093343 5795 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1013 02:47:37.093758 5795 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1013 02:47:37.093780 5795 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I1013 02:47:37.093800 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:37.094917 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.094941 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.100152 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.100214 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:37.100237 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:37.101229 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:37.101258 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.101499 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:37.101530 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.102385 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.102409 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.107638 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.107678 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I1013 02:47:37.107961 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.107985 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.107998 5795 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1013 02:47:37.108758 5795 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E1013 02:47:37.108814 5795 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I1013 02:47:37.108830 5795 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E1013 02:47:37.108872 5795 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I1013 02:47:37.108902 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:37.110030 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.110052 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.115258 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.115322 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:37.115366 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:37.116331 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:37.116359 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.116571 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:37.116599 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.117507 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.117530 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.122743 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.122778 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.02s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I1013 02:47:37.123054 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.123084 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.123097 5795 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I1013 02:47:37.124322 5795 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1013 02:47:37.124379 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:37.125528 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.125554 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.125562 5795 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1013 02:47:37.125593 5795 instancegroups.go:203] waiting for 1ms after detaching instance I1013 02:47:37.126697 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.126722 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.126758 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:37.126802 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:37.126847 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:37.127343 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:37.127387 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.128157 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:37.128193 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.128403 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:37.128446 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.128476 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.229093 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.229175 5795 instancegroups.go:431] Draining the node: "node-1d.local". I1013 02:47:37.230189 5795 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1013 02:47:37.230247 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.231411 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.231468 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.231491 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I1013 02:47:37.231805 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.231835 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.231848 5795 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1013 02:47:37.234223 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:37.235031 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:37.235082 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.236237 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.236275 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.236310 5795 instancegroups.go:431] Draining the node: "node-1e.local". I1013 02:47:37.236351 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:37.237248 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:37.237433 5795 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1013 02:47:37.237459 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.238614 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.238673 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.339231 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.339297 5795 instancegroups.go:431] Draining the node: "node-1g.local". I1013 02:47:37.339341 5795 instancegroups.go:431] Draining the node: "node-1f.local". I1013 02:47:37.339954 5795 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1013 02:47:37.340311 5795 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1013 02:47:37.340339 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.341488 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.341517 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.341538 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:37.341999 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:37.342026 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.343671 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.343710 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.444486 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.444551 5795 instancegroups.go:431] Draining the node: "node-1d.local". I1013 02:47:37.445198 5795 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1013 02:47:37.445234 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.446381 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.446413 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.446426 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I1013 02:47:37.446598 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.446612 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.446620 5795 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1013 02:47:37.446631 5795 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1013 02:47:37.446640 5795 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1013 02:47:37.446654 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I1013 02:47:37.446751 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.446764 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.446771 5795 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1013 02:47:37.447322 5795 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1013 02:47:37.447339 5795 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1013 02:47:37.447348 5795 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1013 02:47:37.447369 5795 instancegroups.go:431] Draining the node: "node-1a.local". I1013 02:47:37.447847 5795 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1013 02:47:37.447868 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.449012 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.449032 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.454252 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.454309 5795 instancegroups.go:431] Draining the node: "node-1b.local". I1013 02:47:37.455007 5795 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1013 02:47:37.455033 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.456181 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.456202 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.461589 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.461636 5795 instancegroups.go:431] Draining the node: "node-1c.local". I1013 02:47:37.462225 5795 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1013 02:47:37.462248 5795 instancegroups.go:469] waiting for 1ms after terminating instance I1013 02:47:37.463394 5795 instancegroups.go:504] Validating the cluster. I1013 02:47:37.463414 5795 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1013 02:47:37.468612 5795 instancegroups.go:540] Cluster validated. I1013 02:47:37.468646 5795 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 2.000s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.005s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.012s === RUN TestParse E1013 02:47:35.485191 5797 versions.go:96] unable to parse Kubernetes version "" E1013 02:47:35.485317 5797 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.010s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.031s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.16s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.220s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.068s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.084s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.074s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I1013 02:47:35.541800 5804 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.069s === RUN Test_RunEtcdManagerBuilder I1013 02:47:35.548903 5806 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W1013 02:47:35.592514 5806 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W1013 02:47:35.594844 5806 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.05s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.125s === RUN Test_RunKubeApiserverBuilder I1013 02:47:35.552549 5807 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.089s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.088s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.027s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.062s === RUN TestServerGroupBuilder I1013 02:47:42.704684 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.717504 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.731335 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.754969 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.763755 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.846223 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.867233 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.883195 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.899696 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.920323 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.933426 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.944460 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.952127 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.958619 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:43.016187 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:43.023913 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:43.031450 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:43.039421 6705 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.35s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.428s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.037s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.047s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.033s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.01s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (1.38s) --- PASS: TestIssueCert/ca (0.63s) --- PASS: TestIssueCert/client (0.47s) --- PASS: TestIssueCert/clientOneYear (0.27s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 1.393s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s === RUN TestAddUntaggedRouteTables I1013 02:47:42.691726 6712 routetable.go:53] DescribeRouteTables: { } W1013 02:47:42.691828 6712 tags.go:67] cluster tag not found on route-table:rtb-1234 I1013 02:47:42.691839 6712 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I1013 02:47:42.691953 6712 iaminstanceprofile.go:193] ListInstanceProfiles: { } W1013 02:47:42.692030 6712 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I1013 02:47:42.692099 6712 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I1013 02:47:42.692172 6712 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I1013 02:47:42.692231 6712 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I1013 02:47:42.692310 6712 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I1013 02:47:42.692375 6712 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I1013 02:47:42.692400 6712 volumes.go:128] DescribeVolumes: { } W1013 02:47:42.692418 6712 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I1013 02:47:42.692513 6712 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:42.692590 6712 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:42.692614 6712 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:42.692665 6712 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:42.692685 6712 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:42.692735 6712 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:42.692768 6712 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:42.692783 6712 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:42.692802 6712 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:42.692825 6712 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:42.692849 6712 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I1013 02:47:42.692870 6712 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I1013 02:47:42.692894 6712 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I1013 02:47:42.692919 6712 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I1013 02:47:42.692936 6712 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I1013 02:47:42.692958 6712 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I1013 02:47:42.692982 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I1013 02:47:42.693009 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I1013 02:47:42.693027 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I1013 02:47:42.693042 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I1013 02:47:42.693060 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I1013 02:47:42.693075 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I1013 02:47:42.693093 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I1013 02:47:42.693107 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I1013 02:47:42.693124 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I1013 02:47:42.693138 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I1013 02:47:42.693158 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I1013 02:47:42.693172 6712 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.067s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.037s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.072s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.011s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.003s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.003s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.044s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.134s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.005s === RUN TestRemovesDuplicateGuardedBlocks W1013 02:47:49.924474 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924531 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924541 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924549 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924555 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924561 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924567 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924575 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924581 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924587 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924594 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924600 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924609 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924618 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.924624 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.924630 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929041 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929076 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929174 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929193 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929282 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929305 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929398 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929418 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929510 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929532 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929662 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929684 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929781 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929802 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.929920 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.929943 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930062 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930083 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930189 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930213 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930318 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930338 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930425 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930449 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930539 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930559 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930655 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930677 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930784 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930805 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.930900 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.930920 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931010 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931030 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931121 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931141 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931229 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931253 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931399 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931422 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931519 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931545 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931617 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931629 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931683 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931693 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931763 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931786 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.931874 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.931910 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932002 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932019 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932107 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932125 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932197 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932220 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932311 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932328 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932423 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932440 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932529 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932546 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932642 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932659 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932746 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932762 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932854 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932873 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.932940 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.932956 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933029 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933045 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933125 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933143 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933209 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933224 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933293 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933308 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933364 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933377 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933456 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933467 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933531 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933543 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933605 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933622 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933704 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933723 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933807 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933829 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.933916 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.933935 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934021 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934076 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934179 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934201 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934307 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934329 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934413 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934433 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934521 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934542 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934626 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934648 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934739 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934761 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934848 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934869 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.934968 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.934991 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935081 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935104 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935196 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935262 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935393 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935414 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935569 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935590 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935686 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935706 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935797 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935817 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.935909 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.935929 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936056 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936080 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936187 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936207 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936299 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936318 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936413 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936431 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936535 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936554 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936642 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936661 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936755 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936773 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936862 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936881 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.936969 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.936988 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937083 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937149 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937250 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937269 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937357 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937408 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937498 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937553 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937667 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937713 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937828 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937875 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.937962 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.937980 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938070 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938087 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938205 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938224 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938323 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938341 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938435 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938453 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938540 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938559 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938696 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938715 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938812 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938831 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.938925 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.938943 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939061 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939083 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939175 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939194 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939279 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939297 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939399 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939418 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939510 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939529 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939625 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939642 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939731 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939749 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939850 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939868 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.939961 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.939979 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.940074 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.940091 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.940179 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.940196 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.940280 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.940298 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.940388 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.940406 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W1013 02:47:49.940934 7938 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1013 02:47:49.940952 7938 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1013 02:47:49.940966 7938 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1013 02:47:49.940979 7938 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1013 02:47:49.940991 7938 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1013 02:47:49.941003 7938 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1013 02:47:49.941013 7938 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1013 02:47:49.941055 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941073 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941086 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.941098 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941153 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.941169 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941181 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.941193 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941205 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.941222 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941269 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941284 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941297 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941313 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.941325 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.941337 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.947770 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.947811 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.947899 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.947934 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948013 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948027 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948106 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948119 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948247 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948261 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948331 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948351 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948418 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948431 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948511 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948524 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948588 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948600 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948666 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948678 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948751 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948764 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948835 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948847 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.948930 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.948943 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949017 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949029 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949094 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949115 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949176 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949187 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949257 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949270 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949335 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949349 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949417 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949430 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949511 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949523 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949599 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949612 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949681 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949697 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949761 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949774 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949847 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949859 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.949923 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.949935 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950011 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950024 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950085 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950097 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950177 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950191 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950297 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950311 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950383 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950396 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950465 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950479 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950553 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950567 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950641 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950657 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950749 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950766 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950834 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950849 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.950922 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.950936 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951008 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951023 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951096 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951119 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951196 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951209 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951275 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951291 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951368 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951382 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951471 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951486 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951548 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951561 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951635 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951649 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951717 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951733 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951799 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951814 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951886 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951901 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.951974 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.951990 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952063 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952077 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952149 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952163 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952228 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952249 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952325 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952340 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952437 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952453 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952528 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952547 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952612 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952626 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952698 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952713 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952787 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952802 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952875 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952890 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.952955 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.952969 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953045 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953061 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953125 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953139 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953203 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953218 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953321 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953335 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953408 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953421 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953500 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953516 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953582 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953607 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953673 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953689 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953767 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953782 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953848 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953864 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.953935 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.953955 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954029 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954055 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954128 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954143 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954208 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954222 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954293 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954308 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954371 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954385 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954467 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954483 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954592 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954607 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954678 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954693 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954761 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954784 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954856 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954872 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.954946 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.954962 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955029 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955044 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955125 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955141 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955226 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955240 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955306 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955320 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955380 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955397 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955455 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955471 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955538 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955570 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955646 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955660 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955736 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955751 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955817 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955832 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.955926 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.955941 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956005 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956019 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956088 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956102 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956163 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956176 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956250 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956264 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956331 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956345 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956410 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956425 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1013 02:47:49.956492 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1013 02:47:49.956506 7938 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.036s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.031s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.071s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.02s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.02s) PASS ok k8s.io/kops/tests/integration/conversion 0.050s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I1013 02:47:49.953263 7942 files.go:57] Writing file "/tmp/TestWriteFile1655658835/001/SubDir/test1.tmp" I1013 02:47:49.953400 7942 files.go:113] Changing file mode for "/tmp/TestWriteFile1655658835/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.041s === RUN TestBootstrapChannelBuilder_BuildTasks I1013 02:47:53.787717 8843 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:53.787893 8843 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:53.787940 8843 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:53.787979 8843 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:53.788006 8843 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:53.788053 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:53.788086 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:53.788104 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:53.788137 8843 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:53.788162 8843 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:53.796713 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:53.923245 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.060671 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.204769 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.322530 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.446557 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.556463 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:54.714463 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:55.211892 8843 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.55s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I1013 02:47:55.335070 8843 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:55.335152 8843 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:55.335203 8843 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:55.335233 8843 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:55.335259 8843 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:55.335289 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:55.335315 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:55.335331 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:55.335352 8843 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:55.335368 8843 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:55.335388 8843 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I1013 02:47:55.336455 8843 zones.go:93] ListHostedZonesPages { } I1013 02:47:55.457506 8843 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.12s) === RUN TestBootstrapChannelBuilder_AWSCloudController I1013 02:47:55.457638 8843 featureflag.go:164] FeatureFlag "ImageDigest"=false I1013 02:47:55.457712 8843 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:55.457754 8843 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1013 02:47:55.457789 8843 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1013 02:47:55.457814 8843 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1013 02:47:55.457846 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1013 02:47:55.457871 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1013 02:47:55.457888 8843 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1013 02:47:55.457909 8843 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1013 02:47:55.457924 8843 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1013 02:47:55.459038 8843 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.10s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.10s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W1013 02:47:55.669272 8843 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I1013 02:47:55.701173 8843 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I1013 02:47:55.701230 8843 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I1013 02:47:55.701245 8843 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I1013 02:47:55.701297 8843 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I1013 02:47:55.701311 8843 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I1013 02:47:55.701364 8843 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I1013 02:47:55.701417 8843 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I1013 02:47:55.701471 8843 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1013 02:47:55.701485 8843 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I1013 02:47:55.701542 8843 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1013 02:47:55.701557 8843 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I1013 02:47:55.701635 8843 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I1013 02:47:55.701715 8843 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I1013 02:47:55.701776 8843 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I1013 02:47:55.701790 8843 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I1013 02:47:55.701802 8843 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I1013 02:47:55.701815 8843 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I1013 02:47:55.701828 8843 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I1013 02:47:55.701843 8843 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I1013 02:47:55.701856 8843 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I1013 02:47:55.701869 8843 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I1013 02:47:55.704569 8843 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I1013 02:47:55.704759 8843 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.004s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I1013 02:47:53.759795 8844 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender1369561676/001 I1013 02:47:53.760089 8844 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender1369561676/001 I1013 02:47:53.760316 8844 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender1369561676/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I1013 02:47:53.764784 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1013 02:47:53.764914 8844 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1013 02:47:53.765009 8844 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I1013 02:47:53.765182 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.765421 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.765520 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.765549 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.765863 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.765928 8844 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1013 02:47:53.765987 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.766088 8844 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1013 02:47:53.766202 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1013 02:47:53.766275 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.766332 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.766372 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.766392 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.766426 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.766458 8844 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1013 02:47:53.766517 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I1013 02:47:53.766643 8844 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1013 02:47:53.766700 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.766786 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1013 02:47:53.766825 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.766849 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.766873 8844 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1013 02:47:53.766939 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.767086 8844 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1013 02:47:53.767139 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.767167 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.767196 8844 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1013 02:47:53.767251 8844 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.767443 8844 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I1013 02:47:53.767515 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.767537 8844 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I1013 02:47:53.767574 8844 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1013 02:47:53.767640 8844 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1013 02:47:53.767679 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.767728 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.767748 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.767770 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.767794 8844 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1013 02:47:53.767829 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.767881 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.767905 8844 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1013 02:47:53.767939 8844 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.767984 8844 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I1013 02:47:53.768027 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1013 02:47:53.768062 8844 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I1013 02:47:53.768117 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1013 02:47:53.768159 8844 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1013 02:47:53.768181 8844 internetgateways.go:66] CreateInternetGateway: { } I1013 02:47:53.768196 8844 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I1013 02:47:53.768248 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.768297 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.768332 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.768346 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.768411 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.768435 8844 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1013 02:47:53.768464 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.768520 8844 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1013 02:47:53.768592 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1013 02:47:53.768639 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.768683 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.768718 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.768741 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.768771 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.768812 8844 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1013 02:47:53.768870 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I1013 02:47:53.769354 8844 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender541284334/001 I1013 02:47:53.769596 8844 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender541284334/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I1013 02:47:53.769930 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.769975 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.770055 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1013 02:47:53.770091 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.770112 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.770137 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.770205 8844 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1013 02:47:53.770392 8844 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I1013 02:47:53.770437 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1013 02:47:53.770472 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1013 02:47:53.770542 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.770583 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.770626 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.770642 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.770665 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.770697 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.770744 8844 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1013 02:47:53.770821 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I1013 02:47:53.771029 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.771067 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.771140 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1013 02:47:53.771173 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.771197 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.771220 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.771258 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.771355 8844 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1013 02:47:53.771394 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.771417 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.771440 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1013 02:47:53.771509 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.771547 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.771585 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.771601 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.771623 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.771645 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.771678 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.771728 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.771751 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I1013 02:47:53.771877 8844 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1013 02:47:53.771915 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.771990 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1013 02:47:53.772023 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.772045 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.772068 8844 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1013 02:47:53.772136 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.772256 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.772376 8844 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1013 02:47:53.772396 8844 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:47:53.772446 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.772474 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.772494 8844 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1013 02:47:53.772559 8844 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1013 02:47:53.772598 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.772636 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.772651 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.772673 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.772694 8844 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1013 02:47:53.772727 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.772777 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.772800 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.772844 8844 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I1013 02:47:53.772939 8844 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1013 02:47:53.772974 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.773045 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1013 02:47:53.773080 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.773100 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.773121 8844 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1013 02:47:53.773185 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.773329 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.773400 8844 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1013 02:47:53.773383 8844 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1013 02:47:53.773438 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.773461 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.773483 8844 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1013 02:47:53.773546 8844 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1013 02:47:53.773583 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.773620 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.773635 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.773657 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.773678 8844 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1013 02:47:53.773720 8844 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1013 02:47:53.773811 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.773835 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.773876 8844 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I1013 02:47:53.773931 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I1013 02:47:53.773987 8844 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I1013 02:47:53.774071 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.774121 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.774157 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.774173 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.774232 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.774257 8844 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1013 02:47:53.774287 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.774320 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.774405 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1013 02:47:53.774428 8844 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1013 02:47:53.774455 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1013 02:47:53.774521 8844 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1013 02:47:53.774557 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.774593 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.774608 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.774636 8844 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1013 02:47:53.774668 8844 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1013 02:47:53.774720 8844 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I1013 02:47:53.774798 8844 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:53.774834 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.774906 8844 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1013 02:47:53.774944 8844 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1013 02:47:53.774965 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.774987 8844 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:53.775019 8844 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:53.775053 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1013 02:47:53.775092 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.775107 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.775128 8844 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1013 02:47:53.775149 8844 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I1013 02:47:53.775246 8844 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I1013 02:47:53.775298 8844 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:53.775332 8844 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I1013 02:47:53.775368 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1013 02:47:53.775382 8844 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1013 02:47:53.775410 8844 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.055s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.057s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.035s === RUN TestDiskRenderAzure I1013 02:47:55.857152 8971 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I1013 02:47:55.857811 8971 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I1013 02:47:55.858304 8971 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I1013 02:47:55.859366 8971 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I1013 02:47:55.859843 8971 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I1013 02:47:55.860356 8971 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I1013 02:47:55.860785 8971 resourcegroup.go:108] Creating a new Resource Group with name: rg I1013 02:47:55.860810 8971 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I1013 02:47:55.861158 8971 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I1013 02:47:55.862038 8971 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I1013 02:47:55.862472 8971 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I1013 02:47:55.862823 8971 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I1013 02:47:55.863415 8971 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I1013 02:47:55.863895 8971 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.041s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.031s === RUN TestProjectIAMBinding I1013 02:47:56.013023 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.013590 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:56.013615 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.014096 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:56.014124 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.014277 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I1013 02:47:56.014404 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.014504 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:56.014524 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.014649 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:56.014673 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.014718 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I1013 02:47:56.014820 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.015053 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:56.015087 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.015428 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1013 02:47:56.015454 9162 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1013 02:47:56.015591 9162 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.092s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.02s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.093s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.082s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.047s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.049s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.011s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.051s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I1013 02:47:58.527243 10011 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I1013 02:47:58.527302 10011 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I1013 02:47:58.527315 10011 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I1013 02:47:58.527328 10011 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I1013 02:47:58.527339 10011 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I1013 02:47:58.527350 10011 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I1013 02:47:58.527361 10011 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W1013 02:47:58.527806 10011 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.060s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.004s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.004s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.003s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.004s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.004s === RUN TestGetProxyEnvVars W1013 02:47:58.494090 10017 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.023s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.026s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.003s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.003s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.023s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W1013 02:48:02.173864 10111 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.063s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 144.4 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.0-r1.apk >>> kops: Build complete at Fri, 13 Oct 2023 02:49:41 +0000 elapsed time 0h 5m 9s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20231013.024434) (2/5) Purging kubernetes (1.28.2-r1) (3/5) Purging go (1.21.3-r0) (4/5) Purging bash (5.2.15-r6) Executing bash-5.2.15-r6.pre-deinstall (5/5) Purging readline (8.2.1-r2) Executing busybox-1.36.1-r13.trigger OK: 379 MiB in 110 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...